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NOTE 

Tms volmne includes substantially the complete Report 
presented to the Department of Economics and to the Pres- 
ident of the University in September, 1916. A few correc- 
tions and emendations have been made at the suggestion 
of members of the Department and of the President; and 
in the interests of brevity a certain amoimt of material, 
presented in full in the Report, has here been represented 
by examples only, or merely referred to. Names have, of 
course, been omitted, and in some cases the mmabers and 
titles of courses. A few sections of the Report have been 
revised to emphasize their general bearing rather than their 
specific application or the circimastances imder which they 
were first written. The Report is published in the convic- 
tion that the problems with which it deals, the method it 
seeks to exemplify, and the conclusions it embodies are 
properly of interest to college teachers, not only of Econom- 
ics but of other subjects, not only in Harvard College but 
in other colleges. Certainly the growing desire to render 
college curricula and college teaching more effective for 
educational ends justifies the presentation of any sincere at- 
tempt to deal comprehensively and in a scientific spirit with 
the teaching of an important college subject. 
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PREFACE 

The inspection of which this Report makes record is ap- 
parently without precedent. There have been investiga- 
tions of certain aspects of college teaching, and studies of 
various phases of college administration^ and there have 
been coUections of tests and standards for college instruc- 
tion; but never before, within the knowledge of those who 
undertook this task, has one college department tumed to 
another, even to the department professionally concemed 
with the problems of teaching, with the invitation to study 
its courses with all possible thoroughness, without limitation 
of time or other condition whatsoever, and with assurance 
of cordial welcome, support, and assistance. 

The invitation bespoke the faet, of which the whole In- 
spection has given further evidence, that the Department 
of Economics feels a vital concem in problems of teaching, 
quite apart from its concem in Economics as a subject; and 
it implied the belief that teaching may be approached in a 
sdentific attitude of mind and improved as a result of sden- 
tific study. In other words, the invitation bore witness to 
the presence and persistence in college instruction, and 
specifically in the teaching of Economics, of pedagogical 
problems not easy to solve either in the light of personal 
opinion or of imorganized and imcritidzed experience. 

An inspection by colleagues whose whole interest centers 

in such problems was a reasonable proposal, which it was 

almost impossible not to accept. Although the Division of 

Education could not wholly foresee how much of the work 

would have to be done under distractions at times almost 

vii 
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fatal to sustained eflfort, it recognized ftilly the magnitude 
of the undertaking and saw in it an exceptional opportunity 
for the objective study of educational problems in the col- 
lege. The Division therefore applied itself to the task with 
f nll consciousness of its possibilities and its importance. We 
have tried to face fimdamental questions, however difficult, 
as they appeared, and to deal with them broadly. Although 
we have kept close to the facts secured in the course of the 
Inspection, we have not sought to escape from consideration 
of situations and issues with which all college teachers are 
concemed. 

We beg to express to the members of the Economics De- 
partment our appreciation of their interest and assistance. 
Professor Bnllock, as Chairman of the Department, and 
Professor Day, because of his connection with the large in- 
troductory course, have been most burdened with our re- 
quests for information and help, and we are especially in- 
debted to them for their constant and imgrudging co- 
operation. 

The Inspection has been the work of all the present mem- 
bers of the Division of Education, as well as two former 
members: Dr. F. W. Ballou, now Assistant Superintendent 
of Schools in Boston, and Mr. D. H. Fletcher, '99, now 
Headmaster of the Detroit University School. Without 
the highly competent assistance of Dr. Alfred Johnson, '98, 
the large tables summarizing the questionnaires could not 
have been completed, and the subsequent discussion of them 
owes much to Mr. Roy Kelly, A.M., '16. In the production 
and interpretation of charts and tables we have had valuable 
help from Mr. E. A. Shaw, A.M., '16, Mr. L. G. Burgevin, 
'15, Miss Eleanor Abbott, Mr. L. P. Damon, A.M., '16, Mr. 
E. A. Lincoln, '13, Mr. R. P. Currier, '12, Mr. C. R. Small, 
'09, and Mr. H. A Sturgis. 

The Division of Education presents this Report to the 
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Department of Economics and to the President of the Uni- 
versity without expectation — as perhaps need hardly be 
remarked — that it will offer final solutions for the many 
and important problems which present themselves in the 
teaching of Economics at Harvard. We have made every 
effort, however, to provide an adequate basis of faet for the 
study of those questions we felt competent to consider, and 
to discuss them comprehensively. It goes without saying 
that we shall take the most genuine interest in further dis- 
cussions or inquiries conceming any of the facts or conclu- 
sions presented in this Report. 

Paul H. Hanus, 
George E. Johnson, 
Ernest C. Moore, 
Walter F. Dearborn, 
Alexander J. Inglis, 
John M. Brewer, 
Henry W. Holmes, 

Chairmatu 
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THE TEACHING OF ECONOMICS 
IN HARVARD UNIVERSITY 

CHAPTER I 

THE mSPECTION AS A WHOLE 

I. CONDUCT OF THE InSPECTION 

The invitation to undertake the Inspection was presented 
and accepted in October, 191 2, but no work of importance 
could be undertaken until 19 13, owing to temporary ab- 
sences of members of the Division of Education during the 
first half of that academic year. During the second half of 
the year plans for the Inspection were completed and dis- 
cussed with members of the Department of Economics and 
with President Lowell. Two of the studies presented in this 
Report were begun, and two others attempted which proved 
impossible to carry out. Chapter VII of this Report, on Mark- 
ing, and Sections I, II, III, and IV of Chapter IV, on Minor 
Quantitative Studies, are based on the work done in the 
spring of 1913. On October 29, 1913, a conference between 
the Department of Economics and the Division of Educa- 
tion was held in Dåne Hall, at which were presented a pre- 
liminary report on the studies begun the previous spring and 
the completed and revised plans for the Inspection. The 
work of the academic year 1913-14 consisted of an inquiry 
conceming the study habits of xmdergraduates, reported in 
Section II of Chapter IV; an analysis of statements of aim 
by the instructors in Economics, reported in Chapter II; 
the transcription on to special cards of 3863 college records 
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of students (Classes 1903-13) who had taken a course or 
courses in Economics; and the preparation of most of the 
charts and tables used in Chapter III. The visits to class- 
rooms began in the spring of 1914 and continued during the 
succeeding academic year, 1914-15. The other work of 
that year was the preparation of the questionnaires, which 
were sent out in February and March, 1915. The academic 
year 19 15-16 was spent in collating the data supplied 
by the retums to the questionnaires and in writing the 
Report. 

At every stage of the Inspection we have found it pro- 
foundly interesting; but the distractions against which we 
often had to contend have lessened the satisfaction we 
should otherwise have taken in it, and in some cases have 
prevented us from completing particular studies and ex- 
periments, as the Report will indicate. If a similar investi- 
gation is ever carried on imder University auspices we would 
eamestly recommend that one man, designated by the de- 
partment or committee in charge of the investigation, be 
given full authority and freed from all other duties for at 
least a year. He ought to have clerical assistance and the 
cooperation of competent graduate students, as well as 
opportunity to conf er with the other members of the depart- 
ment or the committee conducting the investigation. The 
whole department or committee should be responsible for 
the methods and conclusions; but at least one person should 
be enabled to give to the investigation his undivided at- 
tention. 

II. Ams 

With complete freedom to conduct the Inspection accord- 
ing to our own plans, we formulated at the outset several 
general prindples which we considered, and now record, as 
soimd — indeed necessary — for the guidance of such an 
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undertaking. We held, first of all, that our standpoint 
throughout shonld be strictly educational, and hence that 
we had no immediate concem with the highly important 
work of the Department or of its individual members in 
advancing Economics as a science or in serving the public, 
philanthropic institutions, or the business world — except, 
of course, as such service reacts on teaching. Our inquiry 
therefore kept constantly in view the only educational end 
in itself there is — the individual student; and our primary 
concem was with the undergraduate. Conceming the effects 
of instruction in Economics on the character, the com- 
petence, and the career of the student, of whatever class, we 
desired to secure the fullest information possible; and our 
second principle was that this information should constantly 
be sought in the form of verifiable and preferably quantita- 
tive records, so that our conclusions and recommendations 
might have a firm basis of faet. We did not suppose that 
all our studies could be statistical, for the data of education 
cannot alwa3rs be treated statistically with the greatest 
profit; but we wished to avoid, so far as possible, either mere 
opinion based on personal observation which cannot be 
confirmed, or appeal to general prindples which are stiU 
subject to' discussion. As a coroUary to this, we held that 
the Inspection should be wholly impersonal. We did not 
fed called on to criticize the teaching of individual instruc- 
tors, not only because the task would have been ungrateful 
to us, but for the more technical reasons stated in the first 
section of the chapter on Method. Questions of method, 
important as they are, are not as significant in education as 
is sometimes supposed; aims are more important, and the 
general organization of means and materials also. Method 
lies rather within the art of education than within the science 
of it, and must be acquired by practice and continued super- 
vision. We felt, therefore, that our results and recommenda- 
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tions ought to be general and that data as to particular 
courses ought, if they came to us, to be tumed over to the 
Department simply for what they might be worth. 

We decided, also, not to hesitate to deal with any prob- 
lem m its most general form, provided our data justified us 
m dealing with it so. Thus the chapters on Aims, on Meth- 
ods, and on Marking all contain some discussion bearing not 
only on the teaching of Economics but on much college 
teaching in other subjects. We have tried always to keep 
to our basis of faet, if not in the form of quantitative siun- 
maries, at least in the form of analyses of actual records; 
but we have not narrowed the discussion to the teaching of 
Economics when no distinction could properly be made be- 
tween the teaching of that subject and the teaching of others. 

Many specific recommendations we did not expect to 
make. An educational policy must be determined by those 
who have the entire body of facts in mind, and one important 
class of facts we were not, and could not be, in a position 
fully to master — the facts, namely, of Economics as a sub- 
ject. Aims and methods in the teaching of any subject must 
be conceived in the light of socially and individually desir- 
able results in the lives of the students, and in the light of 
the opportimities offered and the limitations imposed by 
conditions, including the characteristics of the students 
themselves, their stage of advancement, and their own pur- 
poses, and including also the values inherent in the subject 
as an educational instrument. These last we know only as 
laymen know them: and our conclusions and recommenda- 
tions are accordingly tentative, with whatever finality they 
may be expressed. They are subject to revision in the light 
of expert knowledge of Economics, being valid in their pres- 
ent form only so far as reasoning competent to the general 
educator can establish them. 
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III. WoRKiNG Plan 

The Plan approved at the conference of October 29, 1913, 
was very useful, as a basis, throughout the Inspection, but 
it was avowedly provisional and we had to depart from it in a 
number of points as the work progressed. Its arrangement 
shows, however, our general conception of the task, and its 
headings are therefore reproduced below. The Report does 
not follow the headings of the Plan because the material as 
it came in proved even more extensive than we anticipated 
and because it took shape more conveniently xmder other 
headings. The Report contains data or discussion, how- 
ever, on all the questions f ormulated in the Plan. 

Preliminary list of questions for use in the Economics 
Inspection, October 2g, igij 

A. Curricula and Student Achievement 

1. What curricula do students pursue? 

(o) Economics A only 

(b) Economics A and Middle Group courses, etc. 

2. What grades do students eam in the several courses? 

3. What growth do students show in ability to deal with eco- 
nomic problems? 

This point cailed for the construction of a "fundamental 
test." (See below, Ch. 4, § IV) 

B. Factors in the Choice of Curricula and in Student Achievement 

I. Selection of Courses. 

1. What are the students' aims? 

2. What guidance does the Department give them? 

II. Grades. 

1. What is the Department's standard of grading? 

2. What is the relation between the students' ages and 
their class in college and the grades they eam in this 
Department? 

3. What is the correlation of grades in Economics and 
grades in History? Government? Other subjects? 
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JSL Methods. 

1. What are the advantages of inductive presentadon in 
the tfiaching of Economics? 

2. What are the advantages and possibilities of laboratory 
and fidd work of a constructive kind? 

3. What are the possibilities of direct Control by instructors 
of the study devoted to material to be memoriised by 
students? 

IV. Aims. 

« 

I. What aims have the members of the Department now 
in view for midergradnate instruction in Economics? 

3. What are the spedal aims of the instructors in their 
sevend courses? 

Two important parts of the Plan we could not carry be- 
yond their initial stages — the construction and iise of a 
''fundamental test" for the measurement of growth in gen- 
eral ability to deal with economic problems, and the conduct 
of controlled experiments in method. Our proposals in both 
cases are discussed in Chapter IV- In neither case was the 
difficulty inherent in the nature of the imdertaking. With 
the cooperation of Professor Day we made good beginnings 
in both. But it was impossible to continue, because nobody 
concemed could give these tasks the necessary time. Al- 
though we had hoped to deal first, by test and experiment, 
with student achievement in Economics, and later, in view 
of the results obtained, inquire into aims, methods, and 
marking, we foimd it imperative to go ahead with the sta- 
tistical studies, the analysis of statements of aim, visits to 
classes, and the questionnaires to students. Under other cir- 
amistances, however, the difficulties we encountered could 
be f ully obviated by relieving investigators and stafiE of other 
burdensin favorof this work. Westill believeinthepossibility 
and in the value of controlled experiment in college teaching 
and of the attempt to measure its results — at least in some 
subjects — by means of a fundamental test. A funda- 
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mental test, as is elsewhere pointed out, cannot take the 
place of a course examination; but as a means of educational 
investigation it is worth taking much pains to devise and 
apply. Experiments yielding quantitative retums can be 
carried on without material injustice to the students in- 
volved and with great promise of benefit to their successors. 
Without these means of securing information about our 
work, we must still rely on data far less convincing, such as 
replies to questionnaires, or else on conjecture, opinion, and 
uncorroborated conclusions from experience. 

IV. Suggestions for Further Study 

One of the supplements to this Report consists of a list of 
questions and problems which was formulated early in the 
course of the Inspection and from which the Plan just dis- 
cussed was derived. Most of the inquiries proposed in the 
list have been made, in one way or another; but in two of the 
main fieids of inquiry there defined — as to the Staff and as 
to Costs — we did not f eel prepared to secure the necessary 
data, and in some others our data must be supplemented 
before sound conclusions can be established. We would 
therefore suggest to the Department further studies imder 
the headings given m this section, below. Other suggestions 
for study are contained here and there in the Report, in 
addition to general recommendations of policy or procedure. 
We would also recommend that the Department conduct 
experiments and inquiries to complete those reported 
(whether as merely attempted or as partly carried out) in 
Chapter IV — the experiments in Method and the project 
of a Fundamental Test; and further, that in Economics A 
and if possible in other courses, studies of marking be made 
similar to the one reported in Chapter VII. It would be 
worth while, besides, to follow up the questionnaire to stu- 
dents with specific inquiries to selected men, espedally as to 
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the vocational use to which they have since been able to put 
their knowledge of Economics. 
The fieids in which we would suggest new studies are : 

1. The scope, organization, and departmental regulation of the in- 
struction, both in Economics as a whole and in its several 
branches. 

A study of the courses given in other universities would be 
a natural starting point for inquiry under this head. The 
inquiry ought to be broad enough to include the problem of 
the relation between Economics and Sociology and between 
Economics and Social Ethics. Important special studies 
might be made of the fieids covered by the several courses — 
their relationships to each other and to various forms of ac- 
tivity outside of college. The suggestion, made by the De- 
partment Committee on Courses of Instruction, that a 
imiform system of keeping lecture notes be adopted, might 
well be considered further, and broadened to cover the 
system of assigning reading and thesis subjects, recording 
written work, and providing source material and opportimi- 
ties for field work. The practicability of crediting in certain 
coiirses active work during the summer months — inves- 
tigations, apprenticeship in banks, corporations, or raihoads, 
govemment service, or service in philanthropic institutions 
— deserves careful study. Might not a solid piece of field 
work in the smnmer af ter the Jimior year be reasonably ac- 
cepted in place of the special Divisional examination, or of 
part of it? 

Comparison might profitably be made between the De- 
partment of Economics and other departments in the Col- 
lege: as to the nvmiber of courses offered, the instructors em- 
ployed, the students taught, concentrations and degrees with 
distinction, doctorate examinations, standards of grading. 

2. The staff — distribution of work among the members of the De- 
partment; the time spent in writing and research, committee 
work, public service, and teaching outside the College; dis- 
tribution of graduate and undergraduate teaching; criteria for 
judging the efficiency of instruction; practicable methods of 
inspection. 

3. Costs — equipment and resources; teaching; publications. 

A study of costs would involve a study of the size of classes 
and the per pupil expenditure for various courses, especially 
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for undergraduate instruction as compared with graduate 
instruction. 
4. Causes of failure and poor work, especially in advanced courses. 
A full study of the cases of D and E men, especially 
of their success in other courses and in after life, might lead 
to interesting conclusions conceming the possibility of meet- 
ing individual needs in college teaching and especially con- 
ceming the opportunities for advice and guidance in the 
choice of courses in college and of vocations afterward. 
Causes of success in college work might be studied in similar 
fashion. 

V. General Impressions from the Inspection 

The Inspection was imdertaken without prepossessions, 
and this Report has not been written to support any pre- 
conceived educational policy ; nor does it contain any section 
advancing detailed proposals for "reform." For reasons 
already given, we must present our conclusions and sugges- 
tions with the expectation that they may be modified or 
reversed by those who have intimate knowledge, outside 
the scope of our inquiry, of an important aspect of these 
problems. Yet a few outstanding features of the whole body 
of data we have studied may be characterized in general 
terms with some hope of profit. They are veins, meta- 
phorically speaking, which run through the statistics, lists, 
and analyses of the Report. In some piaces they are less 
prominent than in others, but to one who has dissected the 
whole mass they stand out with imdeniable cleamess. 

These features are imdoubtedly as characteristic of college 
instruction in general as of instruction in Economics. They 
imply tendencies in college teaching which spring from the 
situation in which the college teacher finds himself . In part 
they are due to tradition, in part to more concrete causes, 
such as lack of fimds, in part to difficulties inherent in 
teaching men of college age. 

College teaching tends to present all subjects from a 
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scientific point of view: it is likely to be academic — and 
the teaching of Economics escapes neither the advantages 
nor the disadvantages of this tendency. It exponnds to 
inexperienced yoiing men theories and masses of informa- 
tion before they have become acquainted in any personal 
way with the elementary facts, processes, and situations 
with which the subject deals. It reqnires a great deal of 
listening and reading, and very little observation, practical 
judgment, or active decision. Its issues are not significant 
at the moment: they induce efifort to make them clear only 
for the immediate purpose of passing examinations or pre- 
senting good theses. The teaching brings students into 
touch with the activities of the world too seldom or too 
partially to permit them to relate what they are studying 
to what men are doing. Students find it hard not to make 
college study a game, in which they may legitimately apply 
themselves to getting marks by studying books, examina- 
tions, and their professors, at the expense of a vital knowl- 
edge of the subject. Progress here certainly does not lie in 
the abandonment of marks, lectures, reading, section meet- 
ings, and the rest of our common machinery, but in the 
persistent efifort to sharpen issues, awaken thought, and 
induce vigorous mental reaction by every means at our dis- 
posal, especially by utilizing every opportunity to bring 
students face to face with the subject as an aspect of life in 
the concrete. 

College teaching, at least in America, tends to be dis- 
connected: it is conducted by units which are not natural 
divisions of interest and activity in life, but are fenced ofif 
from one another for pedagogical purposes. This tendency 
the Division of History, Government, and Economics is 
already vigorously combating through its recent adoption 
of Divisional examinations and Tutorial instruction. But 
even the new scheme runs the risk of remaining artificial if 
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the Schedules it involves are made without clear reference 
to the purposes of the students who elect to foUow them — 
without reference, that is, to the legitimate outcome of any 
Schedule in practical activity or further study. Specializa- 
tion in college ought to have some point. If the old 
elective system made the mistake of permitting college 
boys to patch their curricula together as whim or conven- 
ience might dictate, the new system may fall into the error 
of assuming or forcing in every student a scholarly bent or 
interest which he does not possess and cannot develop. 
College teaching ought to be catholic enough to admit 
among the considerations on which specialization may be 
based such practical purposes as intention to enter diplo- 
matic service, medicine,military service, joumalism, business, 
or any other career. What preparation, immediate or remote, 
any given course aff ords for any given occupation is a matter 
for investigation or for special adjustment of the course; but 
it is injurious to insist that concentration shall be deter- 
mined solely by the artificial distinctions between subjects 
and fieids for distinction, while the ambitions of students 
and the practical possibUities of curricula are ignored. 

College teaching tempts instructors to slight the laborious 
detail of instruction — the minutiae of method, marking, 
and the administration of requirements, the tediousness of 
conf erences, thesis reading, and the checking of results. The 
teaching of Economics probably suflFers less from this tend- 
ency than the teaching of many other subjects; and our data 
suggest a general danger rather than a specific defect. The 
policy of departmental control and reasonable supervision 
already adopted by the Department is nevertheless clearly 
advisable; and both study and experiment with devices, 
methods, and policies are as clearly necessary to the estab- 
lishment of more effective systems and standards in the 
teaching of imdergraduates. 
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College teaching tends to miss the individual — to break 
the contact between teacher and pupil which makes school 
work efifective in certain respects, as it often endangers its 
eflFectiveness in others. More money is the final solution of 
this problem, for more money means more teachers; but a 
better adjustment of the demands on individual instructors 
for teaching, administrative and committee work, and writ- 
ing, is also needed. The policy of expecting every college 
teacher to produce has been beneficial to many instructors 
and harmful to many students. Personal contact is the 
heart of education, and time spent in it ought never to bur- 
den a college teacher's conscience as time wasted. Advice 
as to courses, curricula, future vocations, reading, general 
conduct; discussion of problems and questions in a course 
or a subject; conferences on theses, papers, and examination 
books, both as to content and as to form and style — these 
ought to be as f ree to students from college teachers of every 
rank as the resources of the college can render possible. It 
is clear that the Department of Economics makes due efifort 
to fulfill its obligations in this phase of teaching, and the 
Tutorial plan will doubtless prove especially valuable in this 
very respect: but the general limitation under which all 
college instruction suflFers because there is not time for pro- 
fessors to know their students as individuals, appears in this 
investigation as it unquestionably would in any other, and 
for this particular problem the Tutorial scheme cannot, in 
the nature of the case, oflFer a final solution. 

Looming larger and more impressive throughout the 
Inspection appeared the conclusion that college teaching 
too often fails to reach the student. Obstacles and distrac- 
tions of many sorts prevent educative contact between 
teacher and pupil. The fundamental problem in the College 
is the problem of individual instruction, or, if we may use a 
phrase so general as to cover the whole life of the imder- 
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graduale, the problem of individual development during 
the college years. We find no reason to despair of the college 
or to favor a reorganization on the Junior-College plan; nor 
do we find reason to believe it impossible to solve this prob- 
lem in the large, urban, university college. We see no single, 
simple road to a solution, but we believe that a combination 
of many measures, carefully related and sensibly admin- 
istered, may bring us as near as is himianly possible to full 
success in imdergraduate education. Two conditions, we 
are confident, are essential to any plans or efforts toward 
this end — a general willingness on the part of college teach- 
ers to study the problems of instruction, training, and disci- 
pline as carefully, as broadly, as intensively, and as objec- 
tively as they would study the problems of the subject they 
teach; and an organization of college work which will make 
it imnecessary for any teacher to be so overburdened by the 
nimiber of his students, the variety of the subjects he teaches, 
administrative duties, the claims of research, or the need to 
do remimerative outside work, that he must neglect the 
individuals imder his charge. 



CHAPTER II 

AIMS 

I. Statements from Members of the Department 

OF Economics 

On August 4, 19 13, the following circular letter was sent to 
members of the Department of Economics: 

As a part of our survey of the work of the Department of Eco- 
nomics we are asking each instructor m Economics to formulate for 
us the aims of the courses that he gives; that is to say, we would hke 
a brief but comprehensive statement of what each instructor expects 
the students to get from each of his courses. Doubtless each in- 
structor has a general aim, which is in harmony with the purpose of 
any instruction in Economics or is identical with it; but in addition 
each course also naturally represents the instructor's endeavor to 
realize a particular portion of the general aim or to cover some par- 
ticular aspect of it. In any case, we would like to know what the in- 
structor's purposes are. Will you kindly let us hear from you soon? 

Replies to this request were received from eight instruc- 
tors, and included specific statements conceming eighteen 
courses. The letters themselves may be secured by anyone 
especially interested to read them. They are not printed 
in this volimie, in part because they were sent as personal 
letters without a view to publication, in part because their 
general tenor is presented and analyzed in the following 
discussion in sufficient detail to make the printing of the 
letters themselves unnecessary. Also, the replies are sum- 
marized in note i, Section V, Chapter IV. The present 
chapter gives the results of an analysis, comparison, and 
general discussion of these statements of aim. 

t6 
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The Division of Education was of course competent to 
consider only the educational aspects of the statements 
submitted, without the least assumption of insight as to the 
bearing of particular courses on progress in Economics or 
on social issues or individual needs. The replies were so 
evidently carefnl, and so clear and comprehensive, that for 
this purpose no further inquiry seemed necessary. 

II. The Place of Ams in College Teaching 

Some of the letters state or imply that the instructor had 
not previously given definite form to the aims of his courses ; 
but this faet did not result in any imcertainty of statement, 
for the reason, as it would seem, that the aims thus formu- 
lated were drawn from the actual practice of the instructors. 
They appear, in other words, to be statements of direction 
in the instructors' work, rather than of ideal ends, defined in 
the light of general educational considerations. These re- 
plies (and, it may be added, the drift of testimony from the 
questionnaires and the visits) provide no evidence, therefore, 
of a consistent and clearly enimciated educational policy, 
in the light of which the aims of particular courses may be 
stated. This is imdoubtedly a condition characteristic of 
college instruction in almost every field. 

The common and heretofore possibly the wholesome 
tendency of American college instructors is to attack their 
courses first from the standpoint of the subject, and only 
later consciously to adjust them for use strictly as educa- 
tional instrmnents. No teaching, however, can be com- 
pletely and permanently successful, as teaching, without the 
recognition of definite educational objectives; and this faet 
suggests the importance of formulating aims, and of the 
discussion of aims in department meetings. Certain diver- 
sities in these very statements are probably due in part to 
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the faet that discussion of educational aims and values is 
still so iinusual in departmental and f aculty meetings that 
there is among college teachers no clear agreement as to the 
terms, general conceptions, or particular categories in which 
such discussion can best proceed. In so far as this is true, 
it suggests the value of making the discussion of such state- 
ments as these the order of business for a series of depart- 
mental conferences. 

This suggestion is exactly in line with the noteworthy 
advance made by the Department of Economics in its votes 
separating graduate and imdergraduate instruction and plac- 
ing the latter imder departmental control. The recent regu- 
lations conceming a general examination for students who 
concentrate in the Division of History, Government, and 
Economics look in the same direction — toward imity of 
educational efifort. If imdergraduate teaching is to be made 
generally effective, college instructors must submit to some 
limitation of individual f reedom — a limitation which need 
not be autocratic, indeed cannot become autocratic, so long 
as it is effected by open discussion. In Harvard College, 
the control of imdergraduate courses through the submis- 
sion, for departmental discussion, of outlines covering aims, 
general methods, and requirements of reading, theses, and 
other work, is a poUcy as desirable as it is imusual. The 
visiting of classes by departmental committees chosen for 
the purpose may also be made of incalculable value to in- 
structors. No instructor genuinely interested in the edu- 
cational efifects of his work will object to submitting his 
plans, in detail, to a department meeting, nor to subsequent 
visits by his colleagues and frank discussion of the entire 
conduct of his work. 
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III. Analysis or Statements by Members or the 

Department 

The aims here under consideration may be analyzed and 
grouped as follows: In courses which cover many facts and 
principles variously interrelated, the goveming aim is usu- 
ally the presentation of a systematic survey of the field. This 
presentation is often determined by a point of view which 
the students are expected to acquire even if they f orget much 
of the detail of the lectures and reading. In such courses 
there is also general agreement on traming in assembling 
facts, analyzing them, and reasoning from them (e. g., Eco- 
nomics A, 4a, 4b, 6a, 2a, 2b, 3, i, 5, 14, 31).^ Courses in 
which a general conception is dominant find their chief pur- 
pose in the analysis and clarification of this conception and 
in training the students to apply it to concrete cases (e. g., 
Economics 8, 7, 9). Certain courses involve training in a 
technical method of dealing with facts (Economics i, 9). 
Minor but important aims are given in certain cases: e. g., to 
famiUarize students with the Uterature of the subject (Eco- 
nomics II, I, 14, 31); to present selected problems and to 
provide training in scientific methods of dealing with them 
(Economics 33, 5, 14, 31, 2oe) ; to train in careful and critical 
reading (Economics 14, 31). The stimulation of pubUc 
spirit is stated as a definite aim in Economics A, 4a, 6a, and 
3. General moral discipline through work is given as an aim 

* The pamphlet in which these courses are described will be sent on request by 
the Publication Ofl5ce of the University, 2 University Hall, Cambridge, Mass. 
As the nnmbers attached to courses are sometimes changed from year to year, it 
is necessary to note that the numbers here given refer to courses ofifered in 1913-14. 
The general argument of the chapter is not afifected, however, by such minor 
changes as have since been made, and all but a very few of the niunbers used 
designate the same courses now (1917) as in 1913-14. The only substantial change 
in courses since 19 13-14 consists in the withdrawal of Economics 9, the course in 
Accountingf and the substitution therefor of a half -course in Accounting, numbered 
la and designed specifically for undergraduates. Course i , in StaHstkSf becomes ib. 
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in Economics 4a, 4b, 6a, i, and 3. To improve the written 
EngKsh of graduate students is given as an aim in Economics 
2oe. 

This analysis yields the f oUowing somewhat loose correla- 
tion of aims: 

1. To survey the subject for a comprehensive and systematic view 
of the field to be covered. 

(a) To familiarize the students with the literature of the 
subject. 

(b) To present with spedal care selected illustrative problems. 

(c) To give the students insight into modem economic con- 
ditions and problems. 

2. To train the students in methods of study and thought appro- 
priate to the subject. 

(a) To train the students to deal scientifically with concrete 

problems of a special sort. 
{b) To train the students in a technical method which the 

subject involves. 

(c) To train the students in the careful reading of selected 
books. 

(d) To analyze a general conception and induce clear think- 
ing in terms of that conception. 

3. To stimulate public spirit. 

4. To give general moral discipline through work. 

This grouping may do violence to some of the aims as 
stated, and it is at bast but an arrangement suggested by the 
statements, not contained in them; yet it is probably fairly 
representative of their main trends. The first group of aims 
centers in the idea of presenting the facts and principles in 
the field covered by the courses; the second, in the idea of 
training the students to deal effectively with those facts and 
principles. These two groups are correlative, and together 
they cover by far the greater nimiber of the stated purposes 
of the courses. The third aim is mentioned or implied sev- 
eral times, but apparently as an aim to be realized through 
the general conduct of the courses rather than as a dominat- 
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ing piirpose for which the material of the courses is organized 
and the methods chosen. The fourth aim is an aim com- 
mon to all good college instruction. Both the third and the 
fourth aims depend for their realization, in any case, less 
on choice of materials and methods than on the personal 
attitude and influence of the instructor — on his power to 
inspire, enlighten, and guide ; on his insistence on standards, 
fairness in marking, and abiUty to meet individual needs in 
assigning work; and on similar capacities and habits of 
teaching. 

It may fairly be said that the statements, as a group, 
show a tendency to derive the purposes of instruction from 
the material of the courses. That is, they convey the im- 
pression that the work is organized primarily to cover the 
field, never, to be sure, without reference to the uses of 
knowledge, insight, and technical skill, but without ruling 
interest in the situations and relationships in which the 
student will find himself outside of college. The faet that 
the student is to be an active participant in economic life 
is not ignored; but the main picture of the student sug- 
gested by the statements is a picture of one whose need is 
first of all for systematic or scientific knowledge. There is 
no lack of reference to the student, nor to the qualifications 
he must have to be successful in the work of the courses. 
There is less reference to the question, What will he use his 
achievement in the courses for? 

This condition might suggest a superficial arraignment 
of instruction in Economics as "academic," "lacking in 
practical application," or "imduly scientific." Many of the 
replies to the questionnaires, both graduate and imder- 
graduate, would support some such treatment of the mat- 
ter; but it would obviously be an easy dismissal of what is 
in faet a f imdamental problem in college teaching. 
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IV. General Discussion 

The problem concems not single courses only, but the 
whole curriculum of the student in the given field. This 
is the more apparent now that the Faculty has adopted the 
principles of concentration and distribution; and in the 
Division of History, Government, and Economics, since it 
has established the Divisional examination, the general 
nature of the problem cannot but be evident. The question 
is, From what point of view shall those comprehensive aims 
be stated which are to govem the conduct of the total ofifer- 
ing of imdergraduate instruction in Economics? Aims in 
single courses depend on the larger purposes for which 
courses are organized into Schedules for concentration, dis- 
tribution, distinction, and, in the end, the baccalaureate 
degree. Per contra, the making of such "concentration 
Schedules" as have recently been issued by the Division of 
History, Government, and Economics calls for very careful 
scrutiny of the aims of the courses contained in them. The 
problem centers, therefore, about the use of Economics for 
imdergraduate specialization. 

The statements here imder discussion present no dominant 
standpoint and refer to no common purpose of instruction. 
Vocational application is in at least one statement (Econom- 
ics 9) the determining consideration, as in that case it is 
obviously appropriate that it should be; in other cases (e. g., 
Economics 4a, 4b, 6a) vocational application enters to a 
certain degree as a factor in the formulation of the aim: 
but it cannot be said that the courses in Economics, as a 
whole, are directed toward vocations. They are not intended 
to be courses in Business Administration, and preparation 
for special careers is evidently not considered to be their 
fimction. But there is no clear indication, either, that 
preparation for participation in political, philanthropic, and 
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govemmental activity is the dominant aim. The state- 
ment for Economics 4a, 4b, and 6a alone distinguishes ex- 
plicitly between citizenship and vocation as objectives; 
although other statements (Economics 3, 7, 8, 31) mention 
or suggest the broader social use of knowledge as a determin- 
ing factor in the formulation of the aim. 

The commonest implication of the statements is that a 
general imderstanding of economic conditions and economic 
forces is the nltimate end to be achieved; and there are, 
of course, clear groimds for the defense of so inclusive (even 
if so indefinite) an aim. It may be said that every college 
graduate ought to comprehend the economic order in which 
he must live and work; that the imdergraduate study of 
special aspects of Economics ought to be directed primarily 
toward the deepening and unifying of that comprehension ; 
and that every imdergraduate course ought therefore to be 
fimdamentally a course in the principles of Economics. In 
similar fashion, it should then be argued, every imdergrad- 
uate course in science ought to deepen and unify the general 
understanding of the natural order, and in that sense be a 
course in the principles of science; every course in history 
reveal with added fullness the general evolution of human 
aff airs ; every course in literature lead to a clearer insight into 
the nature of Letters; and so on. If this standpoint is in faet 
accepted in any given field, it connotes acceptance of a view 
of college education which has recently found more and 
more frequent expression — the conception, namely, that 
the final outcome of a college education should be an articu- 
late philosophy or interpretation of life, or an approach 
to it, or at least a definite advantage in the attempt to 
achieve it. 

If imdergraduate instruction is to be purely cultural, 
some such definition of culture is essential as a basis for in- 
struction and the administration of college curricula. Good 
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taste cannot be accepted as an adequate criterion of culture, 
nor the ability to fill one's leisure with refined enjoyment. 
The modem conception of culture implies insight as well, 
and the organization of knowledge, interests, and capacities 
for an intelligent reaction to the demands and opportimities 
of life in a civilized community. Although culture must be 
distinguished from usef ulness, it is in itself supremely usef ul ; 
but it is general, and depends on the development of no 
specialized capacity, no single power, no limited body of 
knowledge. 

It was possible once to hold that intimate acquaintance 
with the Classics could alone enable one to "see life stead- 
ily and see it whole"; but the Classics no longer compre- 
hend even the hiunanities, to say nothing of the sciences. 
The doctrine, subsequently advanced, that formal or gen- 
eral intellectual discipline, obtained from a single subject or 
in a single field, or from a restricted curriculimi, is a possible 
or practicable result of a college education, has been sharply 
questioned, and at least in its cruder forms, disproved. 
(The statements of aim in Economics, it may be noted, are 
very nearly f ree from the suggestion that the student may 
obtain a discipline of mind in that subject such as to enable 
him to deal easily and adequately with every other impor- 
tant aspect of experience.) Indeed, no single study or nar- 
row group of studies is now considered sufficient to provide a 
culture comprehensive enough to result in a penetrating and 
well-balanced view of the modem world and the life of man. 
On the contrary, the dictiun most often quoted is that cul- 
ture demands "something of every thing and every thing of 
something," to the end that the college graduate may in- 
terpret life at once broadly and without superficiality. 

This principle is imdoubtedly much soimder than the 
principle of formal discipline, and, sensibly applied, it may 
ejBfect (and in faet has already ejBfected) very desirable re- 
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forms in the administration of the elective system. It does 
not of itself , however, coimteract a somewhat marked tend- 
ency in our instruction which is generally admitted to be 
imdesirable — the tendency to deal with imdergraduate 
subjects from the point of view of the graduate specialist. 
Nor does it of itself guarantee that the courses provided for 
general or "distributive" purposes shall be sufficiently gen- 
eral. "Everything of something" does not mean that the 
imdergraduate must be brought quickly to the point of view 
of the scientific scholar; "something of everything" does 
not mean that the undergraduate should be given unrelated 
views of many subjects, however leamed the instruction. 
To be effective for general culture the material of every 
course, whether elementary or advanced, should be built 
into a growing imderstanding of the whole field within which 
the course lies. From the standpoint of culture, thus con- 
ceived, it cannot be assmned that undergraduate "concen- 
tration" necessitates research, or that undergraduate "dis- 
tribution" is satisfactory if in the study of any subject in 
any "group" the student may escape without a general and 
related view of the courses he selects. If, therefore, this 
general aim of college instruction is to be accepted and 
worked out to its logicai conclusions, undergraduate courses 
in any field ought, it would seem, to be organically related 
so as to strengthen and deepen the student's general grasp 
of that field, and instruction in every course ought to be in 
some measure broadly interpretative of the whole subject; 
furthermore, in every "group," Schedules of related general 
courses for "distributive" use ought to be arranged, and the 
instruction in those courses ought to include some eflfort to 
reveal the relations of the departments of knowledge in that 
group and of that group to other groups. The statements 
of aim in the Economics courses do not show the results of 
concerted eflfort to work out in this or in some other way the 
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cultural purpose on which they seem to be based, although 
the new requirements for concentration in the Division of 
History, Government, and Economics, and the requirements 
for the several degrees with distinction in this division are 
important steps toward that end. 

In Economics itself, however, it may be supposed that 
the purely cultural aim cannot be strictly adhered to, at 
least in courses designed chiefly for concentration. De- 
parture from that aim is in faet indicated in the vocational 
reference of several of the statements and in the faet that 
direct social applications of a decidedly practical charac- 
ter are also of ten in view. Indeed, these statements (and 
a glance at the titles of Economics courses in the Elective 
Pamphlet) bring home the conviction that the purely cul- 
tural aim is too indefinite. to be accepted as the complete and 
sufficient purpose of a college education in which such a 
subject as Economics is to have any considerable part. In- 
struction in Economics for purely cultural purposes cannot, 
it would seem, be adequate, even for imdergraduate ends, 
in a imiversity college. Direct preparation both for voca- 
tion and for general social service would appear also properly 
to enter as a factor in the aims of instruction. 

This statement has no reference to the obvious desirability 
of relating instruction in Economics to actual economic 
problems, simply as a matter of method. Many of the re- 
plies to the questionnaires show that such reference is de- 
sirable, although not always attempted. It is a principle 
of teaching now generally accepted that, other things equal, 
the best way to begin the teaching of any subject is to bring 
the student face to face with concrete problems which cannot 
be satisfactorily solved except through study of that subject. 
Continuous touch with the concrete is, furthermore, an 
advantage in leaming which is usually worth great pains to 
secure. But direct preparation for dealing with practical 
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problems demands more than this. The use of preliminary 
problems in the section meetings of Economics A has aroused 
interest, engendered a new motive for leaming, and given 
point to the class discussions; but it has not supplied the 
necessary conditions (in that course, to be sure, not requisite 
conditions) for practical preparation. Preparation for work 
of any importance or difficulty demands intensive study of 
actual problems of the work and a method that closely ap- 
proximates (or better, that includes) practical experience. 
Theoretical imderstanding becomes merely a half-way stage 
in progress toward practical efficiency. In fine, vocational 
or other concretely applicable preparation is not merely 
study, but training. 

The measure in which such training should be made the 
aim of any course, or of any part of any course, in Econom- 
ics, it is not within the province of laymen in that subject to 
discuss. By what methods, in what courses, and imder what 
conditions practical aims shall be realized in actual instruc- 
tion only the expert in the field can determine. The sole 
point here in question is recognition of the students' prac- 
tical purposes and the eflfort to satisfy them in such ways 
as are appropriate and possible. At present no statements 
of aim and no annoimcements of courses even imply their 
existence, much less describe methods designed to meet them. 
The layman can only suggest that use of such methods is de- 
sirable, on general educational groimds, for most students 
who make Economics their major study. For specialization 
in this field cannot commonly be considered complete with- 
out it ; and specialization in college particularly demands it, 
since college concentration is usually imdertaken not for the 
purpose of preparing to teach, but rather for participation in 
the affairs of govemment, philanthropy, or business. Even 
the prospective Ph.D. ought, it may be supposed, to have 
some directly practical training; but the prospective Ph.D. 
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is but one in twenty ^ of those who concentrate in Econom- 
ics. The rest are to be workers in other fieids. Their educa- 
tion in Economics would seem to be incomplete iinless it 
leads to the beginnings of practical power in addition to 
general understanding. 

It may be said that the Business School is the place in 
which such power should be developed; and the general 
principle may be advanced that all vocational and other 
practical training should begraduate training, undergrad- 
uate concentration being reserved wholly for intensive study 
under purely cultxural ideals, or for the purposes of pure 
scholarship. (The faet that only a few college men can 
aflford Business School training does not affect the fimda- 
mental question, although it may long have administrative 
importance.) But complete preparation for a professional 
career may readily be assigned to graduate schools, yet the 
permanent question here at issue remain imdecided. For 
there are reasons for doubting the wisdom of a policy which 
makes pure scholarship the dominant aim of college concen- 
tration in every field and for every student. Concentration 
in such a subject as Comparative Literatxure favors, if it 
does not actually necessitate, the ideal of pure scholarship ; 
but in Economics, as in other social sciences, the imderlying 
reference is so intensely practical that a curriculimi of six 
courses without the saving element of practical training 
must often make for remoteness and imreality. The desire 
to take part in the work of the world is strong in normal 
college men. To be sxure, a decided intellectual interest 
may in many cases be a better basis for concentration 
than a weak or vague vocational or social purpose; in 

^ Based on actual count of Harvard graduates retuming for advanced study 
in Economics. Of 460 Harvard undergraduates concentrating in Economics dur- 
ing the period 1913-17 not one has finally received his Ph.D. in Economics from 
Harvard University, although 16 have undertaken some graduate work and a few 
more will doubtless do so nezt year (19 17-18). 
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other cases the impulse toward participation in active life 
may be satisfied by student enterprises, concentration serv- 
ing to engage such purely scholarly interest as the student 
may have or acquire; and possibly concentration in Econom- 
ics may thus in some cases be made to minister to purely 
scholarly interest, or to feed a specific intellectual appetite: 
but it would seem saf er to admit that its natural relation 
is with practical purposes, vocational or social. The choice 
of this field commonly means that the student intends to at- 
tack economic problems as a part of his life work, either in 
his vocation or in other social activities. If he has no such 
intention, it may be doubted that he is acting wisely to 
specialize in so practical a science; his specialization, in 
that case, ought at any rate to be determined with care. If 
his intention is clear, or becomes so, his specialization, it 
may be contended, ought to include, perhaps to culminate 
in, direct practical training. 

This argimient is based on the conviction that a college 
education which results in culture alone — that general 
imderstanding of life which makes leisure significant and 
holds all interests and activities in balance — is for many 
students inadequate, perhaps indeed impossible: it seeks to 
justify actual preparation for specific duties and obligations 
as an important element in many college curricula. But it 
does not support the claim that the college should train 
for professions, or that every student should be forced to 
choose one course which gives direct training for special 
activities. Its immediate object is to present the importance 
of vocational and other strictly practical aims in some parts 
of college instruction in Economics, especially in some of the 
courses that are meantprimarily for concentration. Whether 
anychanges in the instruction now oflfered,and what changes, 
the acceptance of this conclusion would involve, the Divi- 
sion of Education is naturally quite incompetent to con- 
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sider: the question here at issue, although it involves the 
problem of adopting methods of practical training, is in it- 
self solely a question of aims. It is a question, however, not 
only of aims in any particular course, but even more largely 
of aims in planning student curricula, and specifically, curric- 
ula for concentration. 

Concentration is, indeed, the rock in the way of accept- 
ing pure culture as an organizing principle in the teaching 
of Economics. It is easy to see that Economics A, as an 
introductory survey of the subject, chosen in large part by 
men who do not intend to concentrate in Economics, may 
well take but little account of specific vocational or other 
practical purposes. However necessary it may be to con- 
sider such purposes in organizing sections and directmg 
students' work, the instruction itself must doubtless be 
occupied with the task of presenting contemporary economic 
organization and its major problems for the sake of deter- 
mining attitudes, training students to think in economic 
terms, and clarifying the relation of Economics to other fieids. 
Economic history must obviously be taught from a similar 
point of view. Perhaps this point of view is essential in 
other courses. The course in Accoimting seems to be the 
only course in which it would seem clear, even to the layman, 
that the cultural purpose would be wholly out of keeping and 
practical training the only natural character of the work. 
The only generalization the layman may safely venture is 
that the intentions of the students admitted to the course — 
and hence, fimdamentally, the student purposes the course 
is designed to serve — should be the determining factor in 
the definition of its aims and accordingly in the assignment 
of its place in student curricula. (The intentions of students 
cannot be accepted, to be sure, in the crude and half-formed 
State in which students themselves often hold them: the 
purposes of youth need modification and reformulation if 
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they are to be taken into account in providing coxirses; yet 
they must still remain oxir chief reliance in the organization 
of curricula.) In courses chosen for distribution or intended 
to serve as beginnings in concentration, the cultural aim 
may be appropriately dominant, and methods need ap- 
proach those of practical training only in so far as good 
teaching demands it and conditions permit. In some courses 
designed for concentration (e. g., the middle-group course 
in Economic Theory) the cultural purpose is apparently 
prescribed by the subject. To what extent vocational and 
other practical aims may be kept in view in other courses 
for concentration would seem to depend on the factor men- 
tioned — the purposes (properly interpreted) of the students 
admitted to the course. 

Among these purposes vocational and social-service aims 
are surely of great importance. If they exist, they ought to 
be known; if they do not exist, the student's curriculum of 
concentration ought to be affected by that faet. To xurge a 
student to ignore them or thrust them aside in choosing his 
concentration would seem to be justifiable only if he has also 
a strong scholarly taste or interest and can serve his practical 
purpose by a "minor concentration" in his "free" courses. 
The problem is at bottom a problem of educational guid- 
ance. The aims of courses ought to be stated in terms of 
eflfort to meet the needs of students; descriptions of courses 
framed with expUcit understanding as to the student pur- 
poses the courses are intended to serve; instruction guided 
by full possession of all available data as to students' Out- 
look, interests, and intentions. 

The Division of Education recognizes the faet that the 
new Schedules for concentration in Economics may well 
have been framed according to principles determined af ter 
full consideration (perhaps, of course, considerarion re- 
sulting in views adverse to those here expressed) of the issues 
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presented in this chapter. The chapter is written without 
other data in view than those submitted in the statements 
of aim and those supplied by the pamphlets and Communi- 
cations of the Department. If any part of it offers sugges- 
tion for profitable discussion by the Department, the faet 
that the rest is inapplicable will be of small moment. 

Supplementary Note 

This chapter inevitably suggests the whole problem of under- 
graduate training for the professions and the meaning of the bach- 
elor's degree. In its present solution of this problem the University 
has adopted a policy in many respects liberal: no single subject (ex- 
cept for a fundamental coxu"se in English) is required for the degree, 
and no distinction exists between the A.B. and the S.B., except the 
requirement of admission Latin of candidates for the degree in Arts. 
The required English coiu-se may be "anticipated" in the admission 
examinations, and it is not impossible that the argument for a single 
bachelor's degree (the A.B.), without reference to Latin, may even- 
tually prevail; so that in time any student may secxu"e the baccalau- 
reate degree in Harvard College on a course defined, from entrance 
to secondary school through the period of undergraduate training, 
only by broad rules for the selection and organization of studies. In 
one respect, however, the University has been more conservative as 
to the bachelor's degree than many other American institutions: it 
has refused to count toward the degree any professional coxirses. The 
most notable present exception to this rule is the coxmting of a few 
strictly professional courses for teachers — e.g., Education 9, the 
coxu"se for supervised practice in class-room instruction; and it is 
now proposed that a Graduate School of Education shaU be estab- 
lished to take over as soon as possible all work in this field. 

The ideal of å non-professional xmdergraduate course is clear, and 
the Division of Education desires to take no stand against it. It is 
undoubtedly advisable for many institutions to begin professional 
training with the jimior year in college or even earlier; but it would 
seem equally advisable for some to maintain the full coxirse of Kberal 
studies for the A.B., without admixture of strictly professional work. 
For those who can aff ord the time — it has been amply proved that 
entrance to college a year or even two years before the common age 
of entrance is both safe and advantageous — the full "liberal** coiu-se 
in arts provides a highly desirable opportvmity for the maturing of 
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general interests, attitudes, and views, for adventure in scholarship, 
and for the definition of practical and social purposes. It is only for 
this last phase of the whole opportunity we would here contend. 
College work in subjects with a practical trend and outlook ought 
finally, even in Harvard, to take for many students a practical tum, — 
which means, not that the student should be brought suddenly 
under the full control of vocational ideals, as if he had entered a 
professional school, or that vocational training be made the major 
aim of his upper-class coxirses, but that his vocational purpose be 
recognized in his choice of coxirses and Schedules, and the practical 
usefulness of certain parts of his instruction frankly avowed. 
After certain general coxirses, taught for pxu"ely cultxu"al purposes, 
should come Schedules of courses leading toward entrance into the 
purely professional work of the graduate schools or bearing on the 
work of the occupation itself. Concentration according to such 
Schedules should be permitted as freely as concentration in a single 
subject or a set of academically related subjects, on the basis of 
scholarly interest. The coiu-ses need not be technical, narrowly 
"practical," or in any way prematxirely "professional": but their 
relation to each other in the concentration schedule should be openly 
determined by the vocational objective on which they all bear. It 
is the frank avowal of the vocational aim of certain combinations 
of courses that is important. The coiu-ses themselves may deal with 
matters more or less remote from the occupation in view, provided 
that in combination they afford a sultable preparation for truly 
vocational study, and are so advertised. The extent to which any 
given course shall include training of a strictly practical character is 
in any case a matter for adjustment in each course; but this plan 
necessitates no particular amount of practical work at any prescribed 
point. 

Indeed, this plan offers a means of maintaining the generally ''lib- 
eral " character of the baccalaureate curriculum, with allits advantages. 
It does not force the choice of a profession. It does not hamper the 
teacher of every upper-class course by prescribing for his instruction 
a vocational outcome. But it does permit students whose vocational 
purposes are already defined to shape their work in accordance with 
their intentions. It fosters in others, but not \mduly, the tendency 
to define such purposes. It should prevent waste of eflFort and 
simplify the problem of the adviser. 

Professor Day suggests that in Economics the necessary guidance 
should be given by the Tutors. This is doubtless desirable, and in 
making the connections between courses the Tutors can do much 
service by clarifying the relation between the study of college Eco- 
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nomics and the work to which individual students may be looking 
forward. It will still be necessary, however, to establish and publish 
sequences of courses, and to state in the Department pamphlet the 
bearing of courses on preparation for vocations or on vocational 
training in a graduate school. And outside the field of Economics, 
Schedules of other courses — e.g., courses preparatory to the study 
of medicine — ought to be established as approved Schedules for 
concentration. 

In such Schedules continuity of intellectual effort and xinity of 
Outlook must, of course, be safeguarded: a schedule that is merely a 
hodge-podge of imrelated courses would be at least subject to sus- 
picion, even if it could be justified on the groimd of vocational in- 
tent. Some present concentrations, however, lack unity, or at least 
seem to lack it, if one considers only the names of courses; and ex- 
perience with concentrations in Mathematics and Education (per- 
mitted because there is a field of that name, in which one may be 
a candidate for the degree with distinction) shows that a vocational 
purpose can hold together studies which differ considerably in content. 

This chapter is essentiaUy an argiunent for giving up academic 
distinctions and catalogue divisions as a basis for determining cxu"ric- 
ula, and tuming to the realities the rules are meant to serve — the 
purposes and interests of students and the fieids of endeavor and in- 
terpretation in life. 



CHAPTER III 

QUANTITATIVE STUDIES FROM STUDENTS' 
RECORDS — STUDIES IN CORRELATION 

I. EcoNpMics AND Other Subjects — Trend of Student 

Elections 

An attempt is made in this section of the Report to deter- 
mine, in general, what kind of students pursue courses in 
the Department of Economics. 

In the first place, the scholastic interests of the students 
concemed, — in so far as they are indicated by the election 
of courses outside of the Department, — have been studied. 
There is an impression that the students who do the best 
work in the Department show a distinctly scientific and 
mathematical bent. This opinion, however, is not borne 
out by their election of courses. 

The choice of studies in the case of a thousand students of 
the Department was first canvassed. These students had 
taken on the average between three and f our half-courses in 
Economics. The courses taken outside the Department 
were classified for the purposes of this study into three 
groups: (i) History, Government, Education, Philosophy, 
Psychology, Social Ethics, Music, History of Religion, and 
Fine Arts; (2) English, Comparative Literature, German, 
French, Latin, Greek, Italian; (3) Mathematics, Geology, 
Physics, Chemistry, Astronomy, Engineering, Physiology, 
Anatomy, Zoology, Botany, and Mining. 

Among the one thousand records, there were thirty-five 

which showed the election of twelve or more half-courses in 

35 
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the Department. This number of courses would seem to be 

sufficient evidence of specialization in Economics. The 

elections of these students outside the Department are 
shown in the f oUowing table, classified according to the above 
mentioned groups : 

TABLE I 

Student I II m Total Tendency 

I 9 9 . . l8 I-II 

2 12 6 4 22 I 

3 lo 9 8 27 I-II-III 

4 II 9 4 24 I-II 

S 10 7 2 19 I 

6 10 8 s 23 I-II 

7 8 8 s 21 I-n 

8 s 8 .. 13 II 

9 " S I 17 I 

10 10 6 . . 16 I 

II 6 II .. 17 n 

12 2 15 . . 17 II 

13 2 6 10 18 m 

14 7 6 .. 13 I-II 

IS 8 S S 18 I 

16 II 2 I 14 I 

17 7 6 10 23 III 

18 9 2 3 14 I 

19 13 S 6 27 I 

20 10 7 4 21 I 

21 14 12 2 28 I-II 

22 6 II .. 17 II 

23 7 8 4 19 I-II 

24 7 10 10 27 n-ni 

25 12 3 I 16 I 

26 2 14 2 18 n 

27 10 . . 6 16 I 

28 II II 4 26 i-n 

29 6 8 6 20 i-ii-m 

30 I 12 4 17 II 

31 21 5 2 28 I 

32 II 6 6 23 I 

33 II S 4 20 I 

34 14 16 I 31 I"II 

35 9 7 •• 16 I-II 

Explanation of Table I: To show the field in which a student*s work lay, 

the record for each student was classified according to the number of half- 
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courses taken. This was done in the following way: if the total number of 
half-courses was less than twenty, the number in the maximum group 
must be greater than the simi of the other two, in order to be considered 
as sufficient evidence of concentration. If the total nimiber of half-courses 
was over twenty, there must be a plurality of at least three half-courses. 
K there was not a plurality of at least three half-courses, the groups weré 
combined. 

TABLE II 

(Table II is a summary of the result of Table I) 
Group 

I 14 

II 6 

III 2 

I-II 10 

i-ii-ni 2 

ii-iii I 

35 

ExplancUion of Table II: This means that of those students who took 
twelve half-courses in Economics, fourteen, or 40 per cent, were interested 
decidedly in what are termed purely cultural subjects; six, or 17 per cent, 
specialized in language; and only two, or 5 per cent, were students of the 
mathematical and "scientific" subjects. Ten, or 29 per cent, were students 
who took the orthodox college course of language and cultural subjects; 
two, or 5 per cent, had an evenly distributed course. The group which 
combined I and II was clearly inclined away from the scientific side, towards 
the established academic course. Therefore, if we add groups I and I — II 
(14 -|- 10 = 24) we find that 68 per cent of the students were not especially 
interested in the subjects of the third group. Further, if we distribute the 
six students of Group II on the basis of their inclination towards I or III, 
we find that four took no courses in Group III and are concemed only with 
I and II; that one has two courses in each of II and III; and one is in favor 
of III. We may therefore add these four (24 H- 4 =» 28) which would in- 
dicate that about 80 per cent of the students in question are chiefiy 
interested in the studies of Groups I and II. 

The cards of all the students of the Department between 
the years 1904-05 and 191 2-13 were then classified on the 
basis of specialization in one or the other of the three groups. 
Only students, in the first place, who had taken two or more 
courses in Economics; and, in the second place, only those 
who by electing eight or more half-courses in one of the above 
groups gave evidence of some specialization in these various 
groups, were considered. Of the eight hundred and ninety- 
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TABLE m 

I ir ni 

A j6 33 2S 

f^ S* i^ -w 

c $J 1S3 DOS 

D 19 103 4a 

^ _3 17 5 

T/)C^ . - IS4 5^1 2x1 

^6rC€ii&<)# WluieGcQap xj 5S 25 

TaMe IV j^es the same facts redoced to percentages, e. g. , 
17 per cent o^ Gro^ I received A in Eoinnmirs as cxxn- 
pared With 7 per cent ci Groap U and 13 per cent ol (koiq> 
IIL Toikmfi the grades A and B together, 52 per cent ol 
(jrrmp I rective scq>eriar ff^zdts in EconcHnics; 29 per cent 
fA Grf/ap II; and 33 per cent of Groap HL 

lASLE IV 

I n m 

A , , . , 17% 7% 1355 

C . . , , 33 49 48 

U , , , , 12 TO 18 

E , , , , 2 3 2 

Candusians: A study of the records of the dections of 
ZjpjptcyxirnsiUiy nme hundred students of the Economics 
Department shows that about three-fif ths (58 per cait) of the 
students concentrated in their work outside of the Dq)art- 
ment m the language group of studies. About one-fourth 
æncentrated in Mathematics and Science, and less than a 
fifth (17 per cent) in a grotip of studies including History, 
Government, Philosophy, and Fine Arts. The students, how- 
ever, who concentrated in this last group of studies (Group I) 
received superior grades (i. e., A or B) in their courses in 
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Economics in about a fifth mcxe of the cases than did the 
students wbo were dassified in eith^ of the other groups. 
There is no reascm to bdieve that Eomomics has any natural 
affiliation with mathematics and science or that interest in 
mathematics and science piomises well for success in 
Economics. 

n. DiSTRiBunoN OF Grades in Coukses in Economics 

AND IN SECnONS OF COUXSE A 

In the foUowing table, the grades given to thirty-eight 
hundred and sixty-three students in Economics A are shown, 
and secondly, the grades received by eig^t hundred and 
ninety individuals in the more advanced coiurses in the 
Department. These eig^t hundred and ninety individuals 
had each taken six or more half-courses beyond Economics 
A. For purposes of comparison the grades have been re- 
duced to percaitages and their distribution shown in Plate I. 

TABLE V 

DiSTSIBUnONS OF GSADES IN EcONOMICS A AND IN AdVANCED CoUSSES 

A B c D £ ToUb 

Economics A 364 987 1874 523 115 3863 

Per Cent in Economics A . . 9 26 49 14 3 

Advanced Courses 603 2041 3398 718 164 6924 

Per Cent in Advanced Courses 9 30 49 10 2 

The grading, as the table and chart show, is somewhat 
higher in the advanced courses. The smaller niunber of the 
E and D grade students electing advanced courses is sxiffi- 
cient to accoimt for this difference. It is to be noted, fur- 
ther, that the distributions are not symmetricai, there being 
a somewhat larger proportion of A and B grades given than 
of D and E grades. 

Uniformity of marking on the part of the individual in- 
structors in the Department would doubtless be promoted 
by giving some attention to the general practice of the De- 
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partment, as shown in these distributions. This statement 
should not be construed as meaning that the marks assigned 
by an instructor to a small group of students should neces- 
sarily even approximate to these distributions. Quite the 
contrary: It would seldom happen that an instructor's 
"sampling" of the student body, in the case of any one 
class, would be an exactly average "sampling," — which 
is what would be indicated were he to distribute his marks 
according to the percentages given above. But in the 
course of several years the grades in his various classes or 
sections should, when totaled, approximate the above dis- 
tribution, imless, to be sure, there were exceptional factors, 
e. g., election of the course by a superior grade of students 
only.^ These more genpral questions are discussed in the 
chapter on Marking. 

The above distributions represent the average results of 
the marking of the instructors of the Department. Instead 
of reconciling diflFerences in standards by striking an average, 
it would doubtless be better to set up a standard upon which 
several of the instructors already agree, — if a Department 
is f ortunate enough to have such agreement and provided 
there is a reasonable basis for the agreement. For the pres- 
ent, however, it may be suflScient to take the above distribu- 
tions as representing the general standard of the Depart- 
ment of Economics. 

The question of the uniformity of grading in the Depart- 
ment has been studied more specifically in the case of the 
section grading in Economics A. These sections are, in 
the first instance, formed without reference to the quality of 
students, so that in the course of a few years, at any rate, 
each instructor should have secured about the same pro- 

^ In an unpublished study of marking in Harvard courses A. J. Inglis has shown 
that even a standard distribution based on the combination of marks in large in- 
roductory courses cannot safely be used as a basis for distributions in upper class 
courses. 
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portion of the various grades of students, and if his assign- 
ment of grades diflFers much from the general practice, it 
must be accounted for in other ways, e. g., marked supe- 
riority or mf eriority of instruction, — matters which then 
may reasonably be inquired into. 

The grades given in the several sections of Economics A 
during the years 1913-14 and 1914-15, including both 
mid-year and final marks, have been tabulated. The re- 
sults are shown in the f oUowing tables of percentages and in 
the accompanying charts (Piates II to VI inclusive).^ 
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As may be best seen from the charts, there is a much 
greater diversity of practice than can be accounted for on the 
basis of diflFerences in the quality of students in the various 
sections. Furthermore, only in the case of one instructor 
(D) is there agreement between the proportions of grades 
assigned at the mid-years and at the finals. In general, there 
is a larger proportion of low grades given at the mid-years. 
This is due in part to the dropping out of the poorer stu- 
dents af ter the mid-years, in part to an actual improvement 
in the performance of the students who remain. The em- 
ployment of a standard at the mid-years more severe than 
the standard employed at the finals could have no justifica- 

^ At mid-years, an AA section, ao-called, is formed by selecting those 
doing A-grade of work in the various sections. The marks for these sections 
are included only in the combined distribution of the final marks as shown in 
Plate VI. 
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tion except in a dangerous theory of marking for "moral" 
effect. As the chapter on Marking points out, the only 
advisable conrse in assigning grades is to nse every effort to 
be acctirate at the time the grade is assigned. 

One instructor (C) has a perfectly symmetricai distribu- 
tion of grades at the finals, which diflFers very markedly 
from any of the other section distributions, and also from 
the general distribution of grades shown m the precedmg 
chart. This would imply a conscious use of the "probabil- 
ity" distribution curve. This practice, we believe, is not 
justifiable. The employment of a fixed form of distribution 
in the case of a small group of students is bound to do in- 
justice, since no two successive groups, except by chance of 
definite selection, will be the same in the proportions of the 
various grades of students. If any form of distribution is 
to be followed, that representing the practice of the De- 
partment as a whole in the marking of the total group will 
do least injustice. 

III. Elementary Courses and Advanced — Correla- 

TION OF ElECTIONS AND OF GrADES 

A. The Relation of Economics A to the Advanced Courses 
of the Department. Seventy-one^and nine-tenths per cent of 
the students of Economics A elect further courses in the 
Department. This percentage is based on the records of 
3856 students during the years covered by this investiga- 
tion. The extent of further elections beyond Economics A 
is shown in Table VII and in Plate VII. 

TABLE VII 

NUMBERS AMD PeR CeNTS OF STUDENTS TaKXNO OnE OR MORE COURSES 

No. of Counes z a 3 A $ ^ 7 8 o xo zz z^ X3 

Number . 2083 301 569 349 363 308 243 xqx 152 iia 74 48 63 
Per Cent of 

Students 28 8 15 9x0 8 6 5 4 32x2 
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In addition to the nmnber of students, it is also a matter 
of interest and concem to the Department to know some- 
thing of the kind of student who goes on. Do, for example, 
the students who receive grade D in the introductory 
course continue in equal numbers with those who receive A? 
Standing in the introductory course is, of course, not a final 
indication of the student's fitness for further study, but it is 
" contributory " evidence. 

The facts as to the continuance in the Department of the 
A, B, C, D, and E men of Economics A are shown in Table 
VIII and in the accompanying plate (Plate VIII). 

TABLE vin 

NuMBER OP A, B, C, D, AND E Men Who Took One or More 

Courses in Economics 

No. of Courses z a 3 4 5 6 78 9 xo zz xa 13 Totab 

A men ø 20 57 26 37 29 24 15 20 16 9 5 12 366 

B men 290 65 136 75 95 61 64 65 54 35 19 11 14 984 

C men 481 156 276 183 171 171 118 92 63 54 40 28 34 1867 

D men .... IS4 53 ^7 59 49 44 31 16 12 6643 524 

E men 62 7 13 6 11 3 6 3 3 lOoo 115 

Totab 1083 301 569 349 363 308 243 191 152 1X2 74 48 63 3856 

The students who receive the grades of B and C in the 
introductory course are in the large majority in the advanced 
classes. In actual nimibers there are more D men who con- 
tinue than A men; only in the count for more than eight 
courses do the A men begin to outnimiber the D men for 
each additional coxirse. 

If one considers the total nimiber who take six or more 
courses (883 cases), the following are the åndings: 

A B c D E 

loi 262 429 78 13 

11% 30% 49% 9% 1% 

The percentages for the various nimibers of courses taken 
are shown in Table X.^ Fifty-foxir per cent of the E men 

> See below page 47. This table repeats Table VIII in percentages. 
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do not continue. About equal percentages of D, C, and B 
men (26 per cent- 29 per cent) and a somewhat smaller 
percentage of A men (23 per cent) do not continue. There 
is a distinct difference to be noted between the A and B 
men in Economics A, on the one hånd, and the D and E men 
on the other. The data, however, do not show whether part 
of this difference is due to the faet that D and E men leave 
college altogether. If a man leaves college, of course he 
does not take advanced courses in any department, Eco- 
nomics among the rest; so that in the group of those who 
take from six to twelve advanced courses a lower percen- 
tage of men of any given standing is produced by those 
who drop out of college, as well as by those who stay and 
prefer to do their work in other departments. 

Speaking in general, then, about one-half of those who 
receive E in Economics A continue in the Department, and 
approximately three-fourths of those receiving each of the 
other grades. 

Leaving out the question of the E men, some of whom 
doubtless leave college, the grade received in the intro- 
ductory course appears to have no particular effect on elec- 
tions of advanced courses in the Department. 

Another way of grouping the students of Economics A 
is according to the grade of the advanced courses taken by 
those receiving the various marks in Economics A. " Grade " 
here means only the distinction between a course that is 
open to both graduates and undergmduates, and one that 
is open to graduate students exclusively. The differences 
in the extent of elections in the lower, middle, and upper 
group courses may be seen in the accompanjdng chart 
(Plate IX). Thus, of the 46 per cent of men who received 
E in Economics A and took further courses in the Depart- 
ment, 45 per cent took only those courses open to both 
undergraduate and graduate students, only 0.9 per cent tak- 
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ing exclusively graduate courses, this being a single indi- 
vidual. The 71 per cent of the D men who did some ad- 
vanced work in Economics did it exclusively in courses open 
to undergraduates. Of the C men, only 0.5 per cent took 
exclusively graduate courses, ten individuals out of eighteen 
hundred and seventy-four. A slightly larger percentage of 
those who received B in Economics A took exclusively 
graduate courses, 0.8 per cent, or eight individuals out of 
nine hundred and eighty-seven who received B in Eco- 
nomics A (a smaller mmiber, but a slightly larger propor- 
tion). In the case of the A men of Economics A, both the 
actual nmnber and the proportion is greater, for eleven 
men out of three hundred and sixty-f our who received A 
in Economics A went on to exclusively graduate courses. 
This is 3 per cent, or the same proportion of A men as took 
twelve half-courses beyond Economics A. 

The grouping according to grade of courses serves to 
diflferentiate between those who received A in Economics A 
and those who received B. Actual nimibers of individuals 
are as f ollows in our data (Plate IX) : 

TABLE IX 

Number of Economics A men in study 3863 

" who took exclusively graduate courses 30 

** of these who were A men in Economics A . . . . iz 

" who were B men in Economics A 8 

" who were C men in Economics A 10 

" who were D men in Economics A o 

" who were E men in Economics A z 

If the same proportion of the B men in Economics A took 
exclusively graduate courses as of the A men there would 
have been thirty instead of the eight. The same proportion 
of the eighteen hundred and seventy-four C men would 
have given fif ty-seven, instead of ten. Considering the dis- 
proportionately large nimiber of A men who take exclusively 
graduate courses as compared with the B, C, and D men. 
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it may be said that the grading in Economics A has to a 
certain extent diflFerentiated the students, since it gives A 
to a third of the men who af terwards take exclusively grad- 
uate courses, whereas it gives A to only about a tenth of the 
whole number of Economics A students. It gives B to about 
one-third of those who af terwards take exclusively graduate 
courses and to four-tenths of all the students in Economics 

A, from which it may be deduced that a man receiving A in 
Economics A is f our times as likely to go on to exclusively 
graduate courses as is the man in Economics A who receives 

B. In other words, the proportion of A men in Economics A 
who take exclusively graduate courses is f our times as great 
as of the B men. The rule of the Department that only 
candidates for the degree with distinction shall be admitted 
to graduate courses practically excludes from them all but 
the A and B men. 

The general conclusions as to the connection between 
grades in Economics A and the election of advanced courses 
are: (i) About twice the proportion of A and B students take 
six or more courses in Economics beyond Economics A as D 
students. The proportion of C students is midway between. 
(2) The proportion of E students who take courses beyond 
Economics A is only half that of all other grades. Our data 
do not show what part of this is due to E students dropping 
entirely out of college. (3) Four times as large a percentage 
of A students take exclusively graduate courses as of B 
students. (4) Standing in Economics A does not greatly 
deter or incite to further elections in the Department, but 
it is fairly reliable as an indication of a student's probable 
advance into strictly graduate study. 
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TABLE X 

Table Showing Percemtages of those Receiving THE Vasious 

Gkades in Economics A WHO Elect Different Numsers of 

Advanced Courses in Economics 

Number of Half-cooxses Beyond Economks A 
Grade in 
Economks Ao xa 345678 9x0 11 la 

A . 

B . 

C . 

D . 

E . 



23 s 16 7 10 8745 42 I 3 

29748106775 42 z I 

26 8 14 zo 99653 32 z 2 

29 zo Z7 zz 98632 z z 0.7 0.5 

54 6 zz 5 10 3 S 3 3 0-8 



B. The Relation between Grades in Economics A and in 
Other Courses in the Department of Economics. The previous 
sub-section reported the facts as to the sort of students 
who elect advanced courses in the Department, judged on 
the basis of their grades in the introductory course. It is 
also of interest to inquire whether the grades obtained in 
the introductory course give indication of the probable 
standing of the students in the advanced courses of the 
Department. Is there reason for encouraging an A student 
in Economics A to elect advanced courses rather than a D 
student; and is the A student more likely to receive higher 
grades in these courses than the D student? 

Eight hxmdred and ninety individuals are included in this 
study, each of whom took six or more half-courses beyond 
Economics A.^ The distribution of the marks in Economics 
A was that 96 received A; 268 received B; 420 received C; 
78, D; and 28, E. The percentages are as follows: A, 11; 
B,3o;C,47;D,9;E,3. 

The A men of Economics A received seven hxmdred and 
thirty-eight marks in advanced courses, about a third of 
these being A's. The B men of Economics A received two 
thousand and fif ty marks in advanced courses, a tenth of 

1 Seven additional cases to the 883 discussed in section A of this chapter have 
been induded in this part of the study. 
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these being A's. Of the maiks in advanced studies given 
to men wfao stood D and E in Ea»u»nics A, cfoiy one in 
fif ty was an A, wfaile the C mea in EoxKHnics A sucæeded 
once in thirty times in getting an A in advanced couises. 
These facts are shown in the A row of the table, showing 
the percentage of A's in advanced courses obtained by A 
men^ B men^ etc., of Economics A; e. g., thirty-five per 
cent of the marks in advanced courses of men receiving A in 
Economics A were A, f orty-f our per cent of their maiks in 
advanced courses were B, etc 

TABLE XI 

Table Showihc the Pekcentages of the Vaxious Masks m 
Advanced Coueses cf Economics Obtained bt thosb 

RjCCEIVDfC THE VaXIOUS MaRES IN ECONOIOCS A 



Maifcsui 

Adrtooed Coancs 


A 


Marks ID Fmnnmirt A 
B C 


D 


E 


A . . . 


35 


JO 


3 


3 


3 


B . . 


44 


44 


21 


10 


13 


C . . 


20 


40 


60 


5S 


SS 


D . . , 


I 


6 


13 


23 


23 


E . . 


0.3 


0^ 


3 


7 


6 



The heavy-faced type indicates what is called "absolute 
retention"; that is, sixty per cent of the marks of the C men 
of Economics A were also C in the advanced courses. This 
is the percentage of perfect retention. The italic indicates 
^^approximate retention"; that is, twenty-one per cent of 
the marks of the C men were B in the advanced courses, and 
thirteen per cent were D, so that the total "approximate 
retention" here is thirty-four per cent. The grades which 
are still further dispersed from the grade in Economics A 
are printed in ordinary type. The greatest scattering of 
the grades in the advanced courses is in the colunm of 
the IC men, half of whose marks in the advanced courses 
are C. The E men of Economics A receive about the same 
proi)ortion of C's in the advanced courses as do the C men 
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and D men. Fifty-four marks out of ninety-four given in 
advanced studies to men who had received E in Economics 
A were C. 

These facts are clearly shown in the series of graphs in 
Plate X. In general, it is evident that the practice of the 
Department is to lower the grades of the A and B men who 
continue in the Department and raise the grades of the D 
and E men. This practice, there is every reason to believe, 
misrepresents the facts of the case and is due largely to the 
artificialities of grading. It is reasonable to believe that the 
A and B men of the introductory course are quite as capable 
of at least maintaining their rank as the poorer students 
are of improving theirs. To offset this conclusion Professor 
Day has suggested that certain men do good work in ad- 
vanced courses of a more or less practical character, whereas 
the general and largely theoretical character of the intro- 
ductory course may make it difl&cult for them to get marks 
of distinction. 

The actual niunbers of marks received by the various 
groups of students in the six or more additional half-courses 
are as f ollows : (from this table it is possible to calculate the 
degree of closeness in agreement between grades in Eco- 
nomics A and in the advanced courses). 

TABLE xn 

Table of the Different Gkades in Advanced Courses in Economics 
Received by Students Receiving the Various Grades in Economics A 
WHO TOOK Six or more Half-Courses in Economics Beyond Economics A 







Marks in 


Economics A 






Marks in 


the 












Advanced Couraes A 


B 


c 


D 


E 


Sums 


A. . 


. 258 


205 


100 


II 


2 


576 


B . . 


• 325 


944 


703 


57 


12 


2041 


C. . 


• 147 


862 


2006 


331 


52 


3398 


D. . 


7 


123 


435 


131 


22 


718 


E . . 


I 


16 


lOI 


40 


6^ 


164 


Sums . 


. 738 


2x50 


3345 


570 


94 


6897 



so THE TEACHING OF ECONOMICS 

The product-moment (Pearson) coefficient of correlation 
between grades in Economics A and advanced courses in 
Economics of those who took six or more advanced half- 
courses is r = + 39.4 per cent. It wili be of interest to 
compare this coefficient of correlation with those given in 
Section IV. It indicates but a small amoxmt of relation be- 
tween the standing of students in their mtroductory and 
advanced work. This is probably in large part a misrepre- 
sentation of the facts, due to a somewhat arbitrary lowering 
of the grades of the superior students of Economics A and 
an equaUy arbitrary raising of the grades of the inf erior stu- 
dents; but in itself it shows that standing in Economics A 
is not, imder present conditions, a very reliable guide to 
probable standing in advanced courses. 

One f urther point of interest in connection with the rela- 
tion of grades in the introductory and advanced courses may 
be mentioned. The grades in Economics A of students who 
go on to the extent of taking six or more half-courses are 
on the average somewhat higher than the grades of those 
who take fewer courses. In order to secure these averages, 
the f ollowing values were given to the grades : A = i ; B = 2 ; 
C=3;D=4.5;E=6. (Cf. Appendix A, below.) The 
grades of the eight hundred and ninety students who took 
six or more courses average 2.69; of those, twenty-nine himr 
dred and sixty-six in niunber, who took less than six courses, 
the average grade is 2.90, which is about one-j&fth of a grade 
below. The students who go on to do much work in Eco- 
nomics stand higher than those who do not. This supple- 
ments the conclusion presented above as to election of 
advanced courses. The future specialist in Economics is 
marked by what he does in course A; but a man who does 
poorly in that course may nevertheless take a good many 
advanced courses and do well in them. 

Of even more significance are the diflFerences among the 
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groups which elect individual courses. The average grade 
in Economics A of those who subsequently take Economic 
Theory is very high, 1.76; of those who take Economic His- 
tory, 2.54; of those who take Money and Banking, 2.66; and 
of those who take Sociology, 2.64. This shows that there 
is marked variance in the average abilities of the groups 
selected by the advanced courses. It is worth while for an 
instructor to know the standing of his men, not only in the 
introductory course in his department, but in the whole 
range of each student's work. A brilliant group of students 
should not be taught or marked as an ordinary, imselected 
group. 

The recent decisions of the Department conceming elec- 
tion of graduate courses by imdergraduates do not affect the 
conclusions of this section, for the data were gathered from 
the students' records in years before the decisions were made, 
and the problems involved persist in spite of them. 

rv. Economics and Other Subjects — Correlation of 

Grades 

A. The Significance of Corrdatians. When comparison of 
the grades received by the same students in two diflFerent 
courses shows that those who receive A in the one also re- 
ceive A in the other, B in the one, also B in the other, and 
so on; or when it shows a tendency to such agreement so 
marked as unquestionably to be more than a matter of 
chance; and especially when one pair of courses shows such 
positive correlation much more markedly than another pair 
— then it is evidently worth while to discover the factors at 
work in producing so noticeable a result. Thus Economics 
A and Mathematics C show a correlation of 58 per cent — 
an agreement more than half complete; whereas Economics 
A and Admission Civil Government show no correlation at 
all, their coeflScient ( — .01) being so near zero as to indicate 
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no significant relation whatever between the two series of 
marks. What do these facts imply? 

Granted that the students are really the same — that they 
are not only the same persons, but that their general capac- 
ity for work, theu* determination to succeed, and their power 
of assimilation remain xmchanged, then the only other factors 
which can operate to produce or prevent correlation are, 
first, the closely related character of the subjects as they are 
presented to the student by the instruction he receives, and 
second, the accuracy with which the instructors estimate 
each student's achievement. It is natural to suppose these 
factors operative in producing suclua correlation as that 
between Physics C and Mathematics C, which is .61. 

The fxmdamental capacity of the student does not, of 
course, remain always exactly the same; his vitality vanes 
even from day to day, and a change in health or circimi- 
stances may make a marked change in that mysterious 
"central factor" of intelligence which undoubtedly plays 
an important part in intellectual accomplishment : but this 
factor, as a nimiber of studies^ show, does remain fairly 
constant, "good students" persisting throughout their 
whole scholastic career (and, so far as has yet been deter- 
mined,^ later in life as well) in capturing the "high marks". 
Positive correlation may therefore be explained in part on 
the groimd of persistence in relative native ability, including 
in that term the important element of purpose or will. 

This tendency of native ability to give men the same rank 
in two courses no doubt has something to do with a correla- 
tion such as that between Economics A and Government I, 
which is .56; but on the basis of such an explanation we 

^ Dearbom, W. F. The Relative Standing of Pupils in the High School and 
in the University, Madison, Wis., 1909. 

* Cf. President Lowell's study of College Rank and Distinction in Life, AUantic 
Monihly, October, 1903, also President Lowell's study of College Studies and 
Professional Training, Educational Review, October, 191 1. 
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might here expect an even higher correlation, since these 
courses attrået men of about the same age and college stand- 
ing: also, how shall we account on groimds of native ability 
for the difference between the correlations of Economics A 
— Government I, which is .56, and English A — History I, 
which is only .40? The men who take these courses are prac- 
tically the same; they form a large group, without much possi- 
ble variation in native ability from one course to the other. 

There can be no question of the faet that native ability 
is cailed forth in diflFering degrees by diflferent subjects — 
that the students who respond to and work efifectively in 
some subjects are not equally stimulated by others. The 
appeal of a subject is affected, of course, by the method of its 
presentation and by the personality of the teacher; yet it 
may legitimately be supposed that these factors will not, 
ordinarily, so greatly disturb the relative rank of students, 
on which the calculation of a correlation coefficient is based, 
as to obscure the efifect of the subject itself on the varying 
character of their minds. Positive correlation may also be 
taken to indicate, therefore, that the requirements of two 
subjects are germane — that they appeal in equal degree 
to minds of equal capacity, and similar interests, and that 
for the student, the vital question of probable success in 
study may receive the same answer in both. To take one 
of these subjects may be supposed to be helpful in taking 
the other, either because of relation in the content of the 
subjects or because of relation in the point of view or habit 
of attack required. This similarity of content or method 
probably helps to produce the relatively high correlation 
between Economics A and Government I, and the even 
higher correlation (.67) between Economics A and the ad- 
vanced course in Economic Theory, although in the latter 
case it is possible that other factors, to be mentioned later, 
are also at work. 
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Positive correlation presupposes the same degree of ac- 
curacy in marking. It cannot be said that any marking is 
very accurate; justice, as a later chapter of the Report points 
out, is almost as difficxilt in marking as in the law. But 
granted an equal efifort to be just and granted bases of judg- 
ment not essentially different, the variations from accuracy 
in the case of two instructors will not fatally disturb the 
action of other factors in bringing about the same distribu- 
tion of ranks in their two courses. Standards may vary 
without any efifect on correlation, provided students of all 
ranks take both the courses in question; for mere severity, 
equitably applied, will not prevent students at the top of 
the list in an "easy " course from being at the top of the list 
in a "hard" one. But low correlation, or absence of cor- 
relation, or negative correlation, may indicate that marking 
in one course is based on considerations given little weight 
in another; as for example, when in one course a student 
may eam a C or a B by virtue of careful, well-organized, 
faithful work, whereas in another he is required to show 
imagination or graces of form m themes or essays. The low 
correlation between Economics A and English A (.27) may 
perhaps be accoimted for on these groimds. Such a differ- 
ence in principles of judgment may be considered an aspect 
of the difference between one 3ubject and another: but 
in certain cases it may indicate that marking in a given 
course is not well regulated or based on clearly conceived 
requirements. 

One other possibility in marking may affect correlation, 
namely, the possibility that only the good students in one 
course (of the correlated pair) take the other, and that in 
that other, the marking is relatively high : — then correla- 
tion will also be high. This may be partly the case in the 
Economics A — Economic Theory correlation, as facts 
presented at the end of Section III suggest. It was there 



QUANTITATIVE STUDIES SS 

shown that the average grade of men taking Economic 
Theory was very high, namely, 1.76 (or approximately B +) 
and the coefficient of correlation is correspondingly high, — 
(.67). Or if only poor students in one course take the other, 
and the marking is high, then correlation will be low — and 
other cases can be imagined. If correlation is not to be 
obscured by differences of standard, students of all ranks 
must be present in both courses. The method of correlating 
explained below is especially devised, however, to discount 
ordinary differences in the "form" of distributions — e. g., 
the difference between an instructor who habitually gives 
10 per cent of A's and an instructor who never gives more 
than 2 per cent. 

On the whole, it must be admitted that the significance of 
many of the correlation coefficients here reported is in good 
part a matter of conjecture. None of the correlations we 
have worked out is strikingly high; only one is negative; but 
some are much higher than others. Those who know the 
courses must consider the various possible explanations for 
difference in correlation between any two pairs. In the 
case of two pairs of large courses, such as the pairs Econom- 
ics A — History I and Economics A — English A, relative 
native ability as a factor may be dismissed. These courses 
get students of all abilities; and on that score the correla- 
tions of the two pairs should be the same. Difference in 
correlation between the two pairs must indicate differences 
in the relations of the subjects or in the bases for marking. 
There is also the possibility that really marked differences 
in the effectiveness of the teaching would appear in such 
differences of correlation; for if of two courses it were true 
that good teaching in each won successful effort from stu- 
dents in approximately equal degree, whereas of two others 
it were true that one secured it in high degree, but the other 
only from those who could not be discouraged by any teach- 
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ing, however uninspired, then the correlation of the first 
two, other things equal, woxild be much higher than that of 
the other two. No courses we have correlated can be said 
to vary in any such way, but variations in efifectiveness of 
teaching do of course exist, and they cannot be left wholly 
out of account. 

It is not safe, in any case, to draw the conclusion that the 
training given m one course is of advantage in another, 
merely because the two correlate, or that the training in one 
is barren of results in the other because they do not corre- 
late. But when courses do correlate, it is reasonable to ex- 
pect that a student who has done well in one will do well in 
the other, and hence to advise him for his own sake to take 
it — or if one's philosophy so dictates, not to take it. 

B. Corrdatians — Economics and Other Subjects. The 
method by which the main set of correlations (given in 
Table XV) was calculated is explained below. It differs 
somewhat from the method in common use, and makes 
certain appreciable differences in the ranking of the various 
pairs of courses, as to correlation. In order to calculate the 
correlations it was necessary to translate the letters A, B, C, 
D, and E, into nimierical values, which were assigned as 
follows: A = I, B = 2, C = 3, D = 4.5, E = 6. This 
Schedule was adopted af ter a study of the grouping of the 
grades given in various courses.^ 

The first set of correlations was calculated in order to ob- 
tain an average correlation for typical pairs of courses not 
including any course in Economics. It would be desirable 
to get correlations for a larger nimiber of pairs, in order to 
secure an average correlation more widely representative of 
the various subjects taught in the college; but the average 
correlation obtained is useful enough for the present purpose. 

^ For a discussion of the evaluation of grades see Appendix A, at the end of 
this section. 
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TABLE Xm 

CORSELATIONS ^ IN PaIRS OF CoURSES NOT INCLUDING ANY 

COURSE IN ECONOMICS 

Coefficient of 
Number of Correlation 

cases Courses (r « ) 

182 . . . Physics B or C and Mathematics C or F . . . .55 

890 . . . History i " Government I 54 

276 . . . German A or B " Latin A or B 53 

114 . . . English A " History I 32 

68 . . . EngUshA " PhilosophyA 28 

1530 

The weighted average of the coefl&cients of correlation for 
these pairs is .50. This figure may be taken as a guide in 
deciding whether a given correlation between Harvard 
courses is high or low. It, as well as the separate correla- 
tions of Table XIII, is reckoned by the "product-moment" 
(Pearson) method (coefl&cient designated "r'O; and would 
have been somewhat higher if reckoned by the "rank-dif- 
f erence-squared " method (coefl&cient designated "rho")> 
by which the longer list of correlations given in Table XV 
was calcnlated. The range of the correlations in Table 
XIII shows the amount of difference in the tendency of 
diflferent pairs of courses to cause shifting of ranks. 

Table XTV gives correlations between Economics A and 
various other courses, both in Economics and in other sub- 
jects. These are also reckoned by the "product-moment'' 
method, and may be compared directly with the correla- 
tions given in Table XIII. 

^ Coeffidents of correlation are in terms of r, the "product-moment" method 
of Pearson. 
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TABLE XIV 

CoUtELATIONS BeTWEEN EcONOMICS A AND OlHSE COUXSES 



("Product-moment" fonnuU) 



Namberof 



CoCTMJcnt 01 
CoReUtkn 

(r-) 



167 

143 
510 
263 

334 

387 
811 

346 
528 
439 
6897 
432 
334 
168 



Counes 

Economics A and Mathematics C 52 

Economic Theoiy 51 

Government I 51 

Money and Banking 50 

German A or B 48 

Sociology ^ 

Econ. History U. S 47 

Physics B or C 46 

History I 42 

Mathematics F 40 

All other Economics couraes ... .39 

Chemistry I 36 

Latin A or B 33 

English A 23 



The weighted average of these correlations is 41. 

The faet that only three correlations in this Kst are higher 
than the average for the pairs listed in Table XIII and none 
as high as the three highest of that five, deserves some com- 
ment. It is due in part to the faet that the "product- 
moment" method of ealculation takes no aeeount of the 
differences in habit of marking between two instructors, 
as is explained below. By the " rank-diff erence-sqnared " 
method some of these correlations are considerably higher 
in the total list. (See Table XV.) Even so, the only courses, 
outside of other Economics courses, with which Economics A 
correlates particularly well are Mathematics C and Gov- 
ernment I. An explanation for the correlation with Gov- 
ernment I is suggested above; ^ the correlation is not un- 
natural, since the two courses are large under-class courses, 
not unrelated in content. Is it possible that the correlation 

^ It is interesting to note that in reply to the questionnaires a large number 
of students reported Government I as the most helpful course in its relations to 
Economics. 
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with Mathematics C is due to an inherent relation between 
Mathematics and Economics, or to the faet that both courses 
are highly systematic and demand continuous application 
of an analogous character? Neither conclusion can be 
adopted without facing the faet that Economics A and 
Mathematics F show a correlation of only 40.3 (see Table 
XIV); Economics A and Admission Algebra of only 21.6 
(see Table XV). The facts reported in Section I of this 
chapter are also against either conclusion. If it can be 
shown that these correlations are low because of peculiari- 
ties in the way marks are assigned in Admission Algebra 
and in Mathematics F, the conclusion that Mathematics 
and Economics are inherently related will be strengthened. 
In general, it may be said that Economics does not show 
any marked relation to any other field, but in this respect 
is probably not very different from other college courses. 
On the other hånd it is much better in these respects than 
English A. The correlations of English A with History I, 
Philosophy A and Economics A are the lowest, with the 
exception of the admission subjects. Markedly low cor- 
relations give reasonable ground for question as to the stand- 
ards of marking used, or the character of requirements, or 
both. The low correlations with admission subjects shown 
in Table XV, below, are of much significance, especially in 
view of the faet that high-school marks and college marks 
correlate much higher. (Cf . note to Table XV, and Section 
V of this chapter.) 

The foUowing table gives the complete set of correlations, 
calculated by a modification of the rank-difference-squared 
method of Spearman, which, for reason discussed in Appen- 
dix B at the end of this Section, was considered to be appli- 
cable to these cases. It includes a ntunber of correlations 
with admission subjects, and these, it wiU be noticed, are 
all low on the list. 
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TABLE XV 
CoMFLETE List of Corbelations ^ 

Percemtaoe of Cosselation Given by Mbthqd or Rank-Doterence — Squased 
n Pair of Courses p 



143 
182 

811 

167 

510 

263 

890 

276 

334 
346 
528 

387 
6897 

439 
432 

334 
114 

68 

20 

168 

3365 
3479 
3165 

341S 
42 
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Economics A vs Economic Theory 67 

Physics B or C VS Mathematics C or F 61 

Economics A vs Economic Histoiy U. S 59 

Mathematics C 58 

Government i 56 

Money and Banking 56 

History i vs Government i 54 

German A or B vs Latin A or B 54 

Economics A vs German A or B 51 

Physics B or C 49 

History i 47 

Sociology 46 

Marks in Ec. A vs average in Other Economics . . .44 

Economics A vs Mathematics F 43 

Chemistry i 42 

Latin 41 

English A vs History i 40 

" Philosophy A 31 

Economics A vs Admission Economics 29 

English A 27 

Admission Latin 26 

Algebra 21 

Science 21 

English 08 

Civil Government . . — .01 



(( 



(t 



ti 



n 



ti 



P. £. Rank 




inp 


3 


I 


3 


2 


3 


3 


3 


4 


2 


5 


3 


6 


2 


7.5 


3 


7.5 


3 


9 


3 


10 


2 


II 


3 


12 


I 


13 


3 


14 


3 


IS 


3 


16 


S 


17 


7 


18 


14 
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^ For puiposes of comparison with the coeffidents of correlation given above, 
some others based on similar materials may be mentioned. E. A. Lincoln, in a 
study published in School and Society for April 7, 191 7, found a correlation between 
the high school and Freshman marks of Harvard Freshmen of r => 67 +. The 
grades A, B, C, D, and E were given in this study the percentage values of 95, 
83, 68, 53, and 35. The results of Dearbom in the case of the ranks of 238 pupils 
from the Madison (Wis.) high school show a correlation with their standing in 
the Freshman year at the University of Wisconsin of r = 66.8. A general group 
of 472 pupils from several high schools showed a correlation between standing in 
high school and standing in the Freshman year at the University of r » +80. 
These studies, as well as that of Lincoln, are correlations of average standing in 
several subjects, and are not directly comparable to correlation between single 
subjects. Rietz in a recently published study found a correlation of r » 0.528 be- 
tween the standing of 161 students in their college courses in Mathematics at 
Dartmouth and their standing in the Dartmouth Law School. 
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The only additional comment suggested by these tables 
concems the faet that Economics A correlates rather poorly 
with all other Economics courses taken together. This may 
be due m part to the faet that m this case a correlation is 
made between a single mark in the one course and an average 
of marks in other courses. There is, however, a more im- 
portant factor: the coefficient is based on the marks, 6897 
in all, of students who took six or more half -courses beyond 
Economics A. That there is a somewhat arbitrary shif ting 
of the grades of students between the elementary and ad- 
vanced courses has been pointed out in Section III. The 
low correlation depends chiefly on this factor. 

In order that the comparison in this case may be seen 
more in detail, the foUowing tables, which show the per 
mille distribution of students by grade in the introductory 
and advanced courses, are added. 

The marks in the advanced courses are divided into five 
horizontal rows according to the grade in Economics A. 
Table (a) represents the distribution of 1000 marks in courses 
beyond Economics A of students who took six or more half- 
courses in Economics beyond Economics A. This is based on 
the actual distribution of 6897 such marks. 

Table (b) represents the distribution of 1000 marks in 
advanced courses in Economics based on the actual distri- 
bution of marks in four courses, Economic Theory, Money 
and Banking, Sociology, and Economic History of the U. S. 
There were 1604 in the actual distribution. 
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TABLE XVI 
Pek Mille Distrxbihions of Grades in Advanced Coukses in 

EcONOMICS, COMPASED WITH THE GrADES IN EcONOMICS A 

(tf) Grades In Advanced Half-Courses in Economics or T^osb Who Took Sdc 

OR Mors Beyond Economics A 



Grade in 
Economics A 

A. 

B . 

C . 

D. 

E . 



A 

37 
30 

2 
03 



B 

47 

137 
102 

8 

2 



C 

21 

"S 
291 

48 

8 



D 

I 
18 

63 

19 

3 



E 
o. I 

2 

IS 
6 



Sums 
106 
312 

485 
83 
14 



83 296 493 104 24 



(() Grades in Four Advanced Courses; Economic Theort, Monet 
AND Banking, SoaoLOCY, Economic History 



Grade in 
Economics A 


A 


B 


C 


D 


E 


Sums 


A. . . 


. 54 


86 


27 


2 





169 


B . . . 


22 


133 


127 


16 


4 


302 


C. . . 


4 


76 


262 


81 


13 


436 


D. . . 


. 0.6 


II 


44 


2$ 


S 


86 


E. . . 


0.6 





4 


2 


I 


8 



81 306 464 126 23 

In such tables, where the "base" is the same, comparisons 
can be readily made, since simple additions of certain col- 
umns, rows, or diagonals immediately give comparable fig- 
ures. For instance, comparable figures for the "absolute 
retention" can be immediately foimd by adding the prin- 
cipal diagonals. For the general table the absolute retention 
is 485 per mille. For the four special courses it is 475 per 
mille. The "approximate retention" foimd by summing 
the adjacent diagonals is 424 per mille for the general table, 
and 443 per mille for the four courses. 

The sima of the changes in rank of the general table is 613, 
and for the four courses 614. The sum of the squares of the 
changes in rank is 823 for the general table, and 809 for the 
four special courses. The faet of larger sum of squares in 
the general table agrees with the lower corrdation f ound for 
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the general set of marks in advanced courses than for the 
particnlar courses, since the correlation measure employed 
is based upon the squares of deviations from the average, and 
not upon the original deviations. 

The practice of the Department noted above (p. 49) 
appears clearly from Table XVI. In the general table, 172 
A's and B*s in Economics A were shifted a rank down- 
ward in the advanced courses, against 37 A*s retained and 
30 B's advanced to A's; whereas 51 D*s and E's were 
shifted a rank upward against i E retained and 6 D's 
lowered to E's. The facts are even more striking in the 
table for the four courses. 



APPENDIX A 

In order to carry out the correlation studies, the results of which 
are presented in this chapter of the Report, it was necessary to assign 
numerical values to the grades of A, B, C, D, and E. The values em- 
ployed were as follows: A= i;B=2;C = 3;D = 4.5; and E = 6. 
Different values are given to D and E because it is believed that the 
step between C and D and the step between D and E are somewhat 
greater than the steps between A and B and B and C. Grades D 
and E penalize the student in the way of university credits, etc, and 
they are, therefore, assigned, in general, more sparingly. In the case, 
for example, of 3863 grades assigned in Economics A, the percentages 
are as follows: 

E D c B A 

2.98 1353 48.51 25.55 942 

The units adopted are admittedly only approximations. The at- 
tempt was made to calculate them more exactly on the basis of the 
relative frequency of grades assigned, but as the latter varies from 
distribution to distribution, the above approximations, for which 
there was also some justification in the percentile equivalents which 
are sometimes employed in the Recorder's office, were finally chosen. 
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APPENDDC B 

A MODIFICATION OF THE SpEARMAN RaNK — DIFFERENCE 
SqUARED MeTHOD OF CORRELATION 

The formula of correlation suggested by Bravais (1846) to which 
Pearson gave the name "product-moment" is based on the assump- 
tion that the variants in the two series of events in question, — in 
the present instance college marks in pairs of courses, — are each 
distributed according to a "normal" or Gaussian curve of frequency, 
or would be were a sufficient number of cases obtained. The correla- 
tion formnlae by the method of ranks (or the order of merit of the 
individual in the group) as proposed by Spearman, assume a reet- 
angular form of distribution and also assimie that the imit of rank 
which separates any two individuals or scores is the same or equal 
throughout the scale. In the Gaussian curvt of frequency the dis- 
tances which separate any two individuals may be practically zero 
near the centre or mean of distribution, and very large at either ex- 
treme of the distribution. None of these various assumptions alto- 
gether holds for the five rank distributions of marks which are dealt 
with in this investigation. As indicated in Appendix A, the imits of 
rank, in this case the distances between the grades A, B, C, D, and 
E, are probably not equal, and have been dififerently evaluated for 
use in this study. The distributions of marks in college courses, — 
although for the most part as3mimetrical, since more grades of A and 
B are given than of D and E, — approximate much more nearly the 
Gaussian or bell-shaped form of distribution than the rectilinear. 
There is, however, some justification for using a rank-difference 
method of comparison, since, as noted, the distances between the five 
ranks have been fixed in the assigning of nimierical values. 

Both formulae assume further that the general form of distribu- 
tion in the two series to be compared or correlated is the same or 
would be the same were there a sufficient number of cases. This is 
an assumption which ought to hold in many cases in the assignment 
of grades, e. g., the range or distribution of abilities of five hundred 
men in an introductory course in Economics will certainly not diflFer 
materially from their cUstribution in many other introductory courses, 
and especially if all courses are equally open to free election. This, 

6s 
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of course, does not mean that the same men will hold the same ranks 
in the two subjects, but that if there are ten men of very superior 
(or A) rank, and fifty of high, but not superior (or B) rank, etc, in 
Economics, the same proportions should hold in, e. g., History or 
Government. In many of the distributions compared, however, this 
is not the case, and in some instances there are reasons why it should 
not be the case; whereas in other instances the distribution of marks 
can only be explained on the basis of arbitrary differences in the 
methods of assigning grades. 

This faet may aff eet the possible extent of correlation in a given 
pair of courses. The amoimt of correlation depends mainly, of 
course, on the number of changes in rank, e. g., if few, there is a high 
correlation, if many, a low correlation. K we suppose, in the above 
mentioned case, that from year to year ten men are given A grade in 
History, whereas but one man is given an A grade in Economics, it 
is evidently not possible for the ten highest men in Economics to 
secure the same rank as in History. Such changes in rank as these, 
which are caused by differences in the general form of distribution 
of grades, if these differences are purely arbitrary, should not be per- 
mitted to afifect the correlation of the two courses — that is, the ex- 
tent to which men in one group maintain the same rank which they 
hold in the other. A modification was therefore introduced into the 
rank-difference formula to discount or neglect differences in rank 
brought about in this way, and has been applied equally to all the 
pairs of coiu^es compared. In some cases this is doubtless not fair, 
because there may be reasons which justify the distribution of grades 
employed. In view of this and other considerations mentioned above, 
it is not imlikely that the product-moment formula may give, on the 
whole, equally acciu'ate correlations. 

The formula used was worked out by Mr. H. A. Sturges and is as 

SD^obt. — SD^min. 

follows: P = I — ^t;; , g,T^o . in which SD^obt. = the sum 

olJTnax. -f- oL/Tnm. 

2 

of the actual differences in rank; SD^min. = the sum of the differences 
in rank caused by differences in the forms of the distribution; and 
SD%iax. = the sum of the maximum possible differences. The differ- 
ences are in each case squared before summing. A similar modifica- 
tion of the product-moment formula might have been desirable but 
was not attempted. 
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V. EcoNomcs AND Admission Standing — Correlation 

OF Grades 

The correlations between admission subjects and Econom- 
ics were included in the general table in Section III, above. 
They were, as there noted, the lowest of the correlations 
found. It is questionable, however, whether the figures 
really mean what they would seem to mean: namely, that 
there is little or no relation between the standing in school 
studies and university studies, or a given university study, 
such as Economics. There is, on the contrary, good reason 
to believe from other investigations that the relation be- 
tween the general standing in high school studies and xmi- 
versity studies is close.^ The low correlation here is due, it is 
believed, to the standards of marking which prevail in the 
entrance examinations.^ This may be seen in part in the 
lower averages of the grades assigned in the entrance exam- 
inations compared with those assigned to the same pupils 
in the Economics course. These averages are shown in the 
following table, which gives also the correlations in terms of 
r (the product-moment formula). There is no reason why, 
in the case of such large groups of students as are listed in 
f our of the comparisons, the average grade should not be the 
same in the two cases. 

^ Cf. W. F. Dearbom, Relative Standing in High School and University. 
Bulletin of the University of Wisconsin. 

* In a study published in School and Socieiy for April 7, 1917, E. A. Lincoln 
has shown that in the case of a considerable group of Harvard Freshmen, the 
relation between the standing of these pupils in high school and their standing in 
the university is much doser than the relation between their standing in the 
entrance examinations and their university standing. 
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TABLE XVU 
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Economics 
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4.27 


Economics 


2.80 


21.8% 


3165 


3.08 


Science 


2.88 


17-3 


3365 


353 


Latin 


2.88 


iSS 


34IS 


3-95 


English 


2.89 


13.1 


3479 


3-14 


Algebra 


2.88 


11.8 


42 


4.10 


CivU Gov. 


2.82 






In order that these comparisons of standing in the exam- 
ination subjects and the standing in Economics might be 
studied in greater detail, the results were also put into the 
form of distribution tables. For the purpose of this com- 
parison, the groups in question were in each case divided into 
five divisions according to their standing in the admission 
subject in question. The tables in the case of Admission 
English and Admission Latin are here given as examples. 
The first fifth of the group (nimibered i) are the students 
ranking highest, the second fifth are the students ranking 
next highest, etc. The group is then also divided into fifths 
on the basis of standing in Economics A, and the tables are 
arranged to show how many of those who were in the first 
fifth of the grouping in the admission subject remain in the 
first fifth of the Economics grouping, and how many are 
shif ted into the second, third, foiurth, or even fifth divisions 
of the Economics grouping. 

The figures in black face type show the cases of "ab- 
solute retention"; those who are shif ted but one division, 
either lower or higher, show the extent of "approximate 
retention." 
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TABLE XVm 
English-Admission 
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49 
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14 
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4 
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3 . 

4 . 
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2 
IX 

6 

3 
3 
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3 

44 

35 

33 

27 
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54 
56 
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5 
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6 

9 



Economics A i 
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2 

3 
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3 
2 

i 



.8 



Latin-Admission 
Pekcentaoes 



25 

15 

10 

8 
5 



3 

44 
44 
40 

38 
42 



4 
20 

35 
44 
48 
49 



5 

2 

3 
4 
5 
3 



In the following table, the percentages of "absolute" and 
" approximate " retention are shown for each admission 
subject in comparison with Economics A. They show how 
much shifting about there is, or in other words, how little 
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retention of position there is. This is, of conrse, the cause 
of the low correlations found. It can hardly be supposed 
that so much shif ting of relative ranks is due altogether to 
the difference between a college coxirse and an admission 
subject, especially in view of the comparatively high reten- 
tion of rank as students pass from the high school to the 
college. Methods of marking in admission subjects are evi- 
dently in some degree at fault, or else, which is more likely, 
admission examinations offer at best only imreliable evidence 
of ability. 

TABLE XIX 
Percentages of Absolute and of Approxdiate Retektion 

Per cent. of Per cent. of 

Absolute Approximate 

Retention Retention 

English and Economics 27 72 

Latin and Economics 31 79 

Algebra and Economics 32 77 

Science and Economics 30 73 

Civil Government and Economics . . 21 62 

Admission Economics and Economics . 35 60 

VI. Distribution of Grades in Four Advanced Courses 

CORRELATION OF GrADES AND AGES 

A. Distribution of Grades. The results of this study may 
best be presented by an interpretation of the accompany- 
ing graphs (Piates XI and XII) . The courses in question 
are Economics A (for comparison), and Sociology^ Money and 
Banking, Economic Theory, and Economic History. The marks 
were taken from the records of students from 1902 to 1913. 
The niunber of cases considered was: for Economics A, 
3863; for Sociology, 463; for Money and Banking, 230; for 
Economic Theory, 144; for Economic History, 818. Dur- 
ing the ten years covered by our records 3080 men elected 
advanced courses in Economics, the elections in these four 
cases constituting 52 per cent of that niunber. 
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Plate XI shows the distribution of marks in Sociology 
compared with the distribution in Economics A and the 
combined distribution for all four advanced courses. There 
is an obvious trend toward the higher grades, although it is 
not striking. Plate XI also presents the same comparison 
for Money and Banking. In this case there is a trend toward 
the lower grades, about as clear as is the trend in the oppo- 
site direction in Sociology. Plate XII shows a very decided 
trend toward the higher grades in Economic Theory. In the 
case of Economic History (also on Plate XII) the trend is 
again toward the lower grades, but it is very sUght. This 
course shows a distribution very closely in agreement with 
the joint distribution for the four advanced courses. 

It is natural to expect that grades in advanced courses will 
be somewhat higher than grades in the introductory course; 
but the divergence of the grades in Economic Theory from 
the joint distribution for the foiu" advanced courses would 
seem to call for some explanation. It may no doubt be due 
in part to the small number of cases considered, as com- 
pared with the nimibers in the other courses; and it is prob- 
ably due also to the faet that Economic Theory is known to 
be a diflSicult subject, which only the more able students 
choose. (Cf. Section III, above, p. 51.) In this course it 
would be especially worth while, however, to examine the 
standard of grading in the light of a knowledge of the grades 
in other courses secured by the men registered in it in any 
given year. 

B. C or relation of Grades and Ages. Piates XIII and XIV 
show in two ways the distribution of grades in Economics A 
to students of various ages compared with total distribu- 
tions selected from the 3863 cases. The first set of graphs 
compares the distribution of grades for six different ages 
with the normal distribution for the course. The second 
compares the range of ages for men receiving each grade 
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With the normal range of ages in the course — i. e., with 
the ages of all who took the course from 1902 to 1913. The 
graphs show clearly that yoxmger men succeed more of ten 
and more f ully than older men : in other words, the brilliance 
of the men wko enter Economics A at an eariy age finds no 
obstacle in the character of the course. The course does 
not favor, much less demand, maturity. It is "geared" to 
18, 19, and 20. 

In the case of Sociology (Plate XV and Plate XVI) the 
same general result holds, although without quite so strik- 
ingly regular an advantage for the younger men. This 
subject cannot be said, however, to put a premiiun on delay 
in taking the course. A larger proportion of yoxmg men 
than of old succeed in it. 

The same outcome, less clear, but not imcertain, appears 
in Money and Banking (Plate XVII and Plate XVIII) . (The 
irregularity of the last figure on Plate XVIII is obviously 
due to the small nimiber of cases in question.) 

In Economic Theory (Plate XIX and Plate XX) the tend- 
ency of youth to win fuUer success is not so clear. The older 
men are often at an advantage; at any rate, the course does 
not especially favor the yoxmger men. 

Plate XXI and Plate XXII show that Economic History 
pays almost no respect to ages. There is a slight advantage 
for men of twenty-three, but it is only slight. 

These graphs, taken together, corroborate the results of a 
previous study, presented herewith among the Supplements 
to this Report (Supplement IV). Yoimg men are not at a 
disadvantage in college merely because they are yoimg; 
nor are they at a disadvantage on that accoimt in advanced 
courses in Economics. If a student has proved his ability in 
Economics A, it would be unfair to discourage him from 
entering any of these courses because he happened to be 
nineteen or yoxmger — although possibly he woxild do well 
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not to try Economics ii until a year or two later. Youth, 
in fine, is not of itself a handicap, and a yoiing man who 
does well should never be passed by for academic honors or 
encouragement in f avor of another who is his superior solely 
in years. Even the mature man who has gained in seri- 
ousness by several years out of college is likely to be less 
successful than the yoxmger man who has never grown 
intellectually * * rusty . ' ' 



CHAPTER IV 

MINOR STUDIES AND PROPOSALS FOR EXPERIMENT 

I. Habits of Study in Economics A and Other 

Courses 

Habits of study among college students are often the sub- 
ject of discussion and comment, more or less serious, and 
every one knows, from his own experience and observation, 
more or less about them; but no conclusions or proposals 
conceming study, as the chief duty of college men, have ever 
been based, so far as we know, on a plain record of the 
actual practices of the students. This part of the Inspec- 
tion is based on a record of that kind — a record which 
might, indeed, be more extensive, but which is reliable as 
far as it goes. 

A member of the Division of Education presented to a 
section in Economics A and to a few other groups of stu- 
dents a request for records of all their studying from Decem- 
ber lo, 1913, to the end of January, 1914. The general 
purpose of the records was explained, although without 
reference to this Inspection; and the students were urged 
not to volimteer to supply records unless they were really 
interested in the problem imder consideration and could 
promise to make their records complete. Seven men from 
the Economics A section volimteered and fif teen men from 
other courses, one of whom, a Junior, was taking Economics 
2 a. The fourteen men from courses in departments other 
than Economics did not all hånd in records of study for their 

full list of courses, so that this study is based on the eight 

74 
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sets of records from Economics students, although the com- 
ments of the other students are also used in the brief final 
discussion. There was no attempt to make this study 
statistical in the sense which implies the counting or aver- 
aging of a large number of records. It was a study of a few 
selected cases, for the sake of securing sets of records limited 
in number but complete in character. 

As will be seen from the foUowing record of marks, the 
men were not brilliant; but all were faithful and serious in 
their attitude. 

Mid-Year Grades — 1913-14 

Student Economics A Other Counes 

1 D-f £iiglish2:B. Philosophy i: C-f. FrenchaiA— 

2 D-f Classical Philosophy 66: B— . History loa: B. 

Comparative Literature 9: A— . English 24: 
C—. History 14: C—. 

3 D— English 27: C. Latin 10: C-f. Music 4: D. 

Social Ethics: 4: B—. Music 3: B—. 

4 C+ English 22: C. English 2: D. Physiology i : B. 

5 C-h Engineering 3: B-h. Mathematics $: B-h. En- 

gineering 41 : B-h. Physics i : A. 

6 C French 9: B — . Comparative Literature i: C. 

Spanish 5: C-h. Government 17: C. 

7 B Chemistry 3: B. Mineralogy 2: B. Geology 8: 

A— . Geology 10: A. 

8 (Ec. 2a) C German A: C-h- History 30a: C. History i6a: 

B. Education A: A. 

The following letter and sample record slip was sent to 
each of the volunteers. 

Cambridge, December 8, 1915. 

My deak Mr. 

You are among those who gave me their names in responsa to my 
recent request for cooperation in seoiring acoirate records of the 
study habits of college men. I take for granted, after what I said at 
that time, that I may now rely on you for a serious and faithful efifort 
to supply me with die data I am seeking. Let me repeat the assur- 
ance that the facts you record will be used only impersonally, as a 
basis for general conclusions, and without the slightest reference to 
the name of the recorder. Your own records will be open at any time 
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to your inspection, in 5 Lawrence Hall, and I shall be glad to confer 
with you, if you care to have me, on your methods of study or on any 
educational questions which this record may suggest to you. 

You will find enclosed slips on which the records are to be made. 
In making your records please observe very carefully the following 
points: 

I. Make a separate record for each distinct "piece" of study. 
That is, if you tum from one topic to anoUier in the same 
course, or from one kind of work to another in the same 
course, or from the work of one course to the work of another 
course, make a separate record for each. 
II. Record every piece of study iromediately at the completion 
of it, or as soon thereaf ter as possible. The purely mechanical 
details of the record may be set down at the beginning of the 
study, and the rest filled out at the end of it, with the ex- 
penditure of very little time. 
III. Be absolutely frank in filling out the records. The back of 
the slip may be used for comment, if the space allotted on the 
front of the slip is not sufficient. 

The enclosed slips need very little explanation. You will find one 
of them filled out as an example. Please let me know at once if you 
discover any difficulty in filling out the slips. You may find me in 
Lawrence 5 any day at eleven, or you can reach me there by tele- 
phone or mail. The enclosed slips are intended to cover the work 
of a week. I will mail to you a similar set of slips every week. The 
addressed envelope with the slips is for the return of the week's records. 
Please mail them on Saturday so that I may receive them Monday 
morning. Your first set of records should be mailed Dec. 13. 

Under the heading "Material" please give the exact pages covered 
in your study when this is possible; if not, record in some way the 
extent of the material you used. Please note that laboratory work 
and field work should be covered in these records. In such cases make 
a brief statement, imder the heading "Material," of the character of 
the work. A piece of mechanical drawing in an Engineering course; 
an experiment in a Physics course; a laboratory test in a course in 
Chemistry; a visit to an institution in a course in Government; these 
are all examples of forms of study, the character of which should be 
recorded under the heading. 

It may also happen that the work to be recorded will be writing, 
or organizing material for writing. These facts should also be noted 
under the heading "Material." 

Under the heading "Purpose" please state whether the work is 




MINOR STUDIES AND EXPERIMENTS 77 

done under the general requirements of the course, as a part of the 
regularly assigned reading, in special preparation for a set examina- 
tion, or for any other particular purpose. 

Under "Method" record simply the outstanding facts as to your 
procedure. If you memorize headings or take notes on reading, or 
just read straight ahead without pausing to organize the material, or 
work over material you studied into a special form of organization 
for your own purposes, please indicate the faet briefly in your record. 

tinder "Comment" please put down in any case your own reaction 
as to the value of the time you spent. If you feel sure that you have 
grasped the material and can remember it, use the term "satisfactory " 
or some similar term. If the work required seemed useless to you, if 
you foimd no profit in the book you were studying, if the work you 
did conf used rather than clarified your ideas — please make an ap- 
propriate record. Under this heading I should be glad also of indication 
of interruptions or distractions which you encoimtered in your work. 

With the hope that your cooperation in this study will yield some- 
thing to you as well as to others, I am 

Very sincerely yours. 

Sample Slip 

Name: Doe, John H. Course: Economics A. 

Date: 6 Dec., '13 Hours: 3:30-4:30 Place: Upper Mass. 
Material: Taussig: Prin. Econ., Ch. 32, pp. 449-467. Chapter on 

Foreign Exchanges. 
Purpose: Regular weekly assignment. 
Method: ist reading for general impression; then outlined by sec- 

tions and paragraphs. Spent 10 minutes memorizing a simi- 

mary, and 20 minutes thinking out typical cases. 
Comment: I imderstand the chapter, but need opportimity to 

follow the details of exchange as actually practised. 

The several sets of record were summarized, both for the 
more mechanical matters and for methods, comments, and 
general impressions, as shown in the following example: 

Set I 

(a) Number of records submitted — 119. 

(b) Time spent in study: 

Economics A . Study, on 16 different dates, amounting to 52 hours. 
English 2 . . . Study, on 20 different dates, amounting to 58 hours. 
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French 3 . . 
Philosophy i 
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{c) Piaces: 
Economics A . 

English 3 . . . 

French 3 . . . 

Philosophy i . 



(d) Purposes: 
Economics A . 



English 2 . . . 



French 3 . . . 



Philosophy i . 



Study, on 12 different dates, amounting to 39 hours. 
Study, on 12 different dates, amounting to 30 hours. 



College room (Stoughton), 13 periods; Massa- 
chusetts Hall, 9 periods; home, 2 periods; Pi Eta 
Library, i period. 

Massachusetts Hall, 19 periods; college room, 8 
periods; home, 8 periods; on trains, 3 periods; in 
dining hall, i period. 

Home, 36 periods; Pi Eta Library, 9 periods; col- 
lege room, 6 periods; Massachusetts Hall, 4 
periods. 

College room, 15 periods; Massachusetts Hall, 9 
periods; Pi Eta Library, 4 periods; home, i 
period; on trolley cars, 4 periods. 



For midyear examination, 12 periods. 

For weekly assignments o£ reading, 11 periods. 

For review preparatory for section meetings, 2 

periods* 
For midyear examination, 24 periods. 
For lesson o£ succeeding day, 11 periods. 
For &dng memory passages, 4 periods. 
For midyear examination, 7 periods. 
For lesson of succeeding day, 9 periods. 
For review of preceding lesson, 6 periods. 
For midyear examination, 29 periods. 
For supplementary and advanced reading, 2 periods. 
For making up lecture lost, i period. 
For section meeting, i period. 



This man studied every day from December 10 to Decem- 
ber 18 inclusive, and from January 6 to February 7 inclusive. 
He scattered his periods of study throughout the day, from 
8 A.M. to 2 P.M., but studied more from i to 5 p.m., and from 
8 to 12 P.M., than at other hours. Some of his periods of 
review for midyears were long — one day of "cramming" 
for Economics A including an hour and a quarter in the 
morning, f our hours in the af temoon, and five hours in the 
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evening. The commonest length of his periods was an hour. 
He often recorded periods of ten or fif teen minutes. On one 
day he spent five hours at diff erent times on assigned reading 
in Economics A and remarks, "Toward the end my brain 
seemed tired of Economics, and while I could pick out the 
point, it did not seem as vivid." Several records note that 
study late at night "af ter a Symphony concert" is "imsatis- 
factory." 

His method of study in Economics A was good: he read 
the whole chapter or section first for a general impression, 
and reviewed it paragraph by paragraph to fix details. Acts 
and scenes in Henry IV for English 2 he håndled in the 
same way. His method of memorizing for English 2 was 
more doubtful: he memorized two or three lines at a time, 
adding them to what he already knew. In Economics A 
he committed outlines to memory and he took notes on all 
his reading in Economics and Philosophy. In French he 
made fuU use of the dictionary, recording such work as 
"tedious" but noting the pleasure he seciu'ed afterwards 
in rapid rereading of the text. He seldom went over any 
assignment less than twice, often covering a diflScult assign- 
ment three times. Once he records that in taking notes he 
"made an extra effort to use his own language and seemed 
to get more out of it.'* 

This man's records give a clear impression of faithful 
effort spent almost wholly in memorizing. He never dis- 
cussed problems in Economics or Philosophy with himself or 
— so far as his records show — with others. His study was 
bookwork — leaming what the text and his reading notes 
and his lectiu'e notes presented. He never records the least 
dissent from what he read, although he sometimes found it 
"duU"; nor does he record any enthusiusm higher than 
"interest." His chief desire, in his own phrase, is to "get 
a firm grip on the material." 
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The other sets of records may best be summarized more 

briefly. 

Set 2 

Number of records submitted — 131. 

This man studied dafly form December 10 to December 
18, read much during the vacation and studied daily from 
January 5 to February 6; but he often studied in short 
periods of ten, fif teen, or twenty minutes, on one occasion 
tuming from one subject to another and back again in the 
course of an hour. He studied mostly in the late aftemoon 
and evening. His longest period of consecutive work on one 
subject was four hours and a half in History 10 a. His study 
was continually interrupted and very often casual and 
hurried. 

There is little to indicate any fixed method, either in 
general or for any particular course. He often records 
thinking about the subject before beginning his work, and 
he usually marked or reread significant passages. Once he 
records marking the topic sentences in all the paragraphs 
in a long chapter assigned in History 14. A very common 
remark is to the effect that he got a f ew good points but no 
unified impression. Much of his study has reference to 
written work in preparation, the subjects of which he had 
constantly m mind. Apparently he did considerable thmk- 
ing as he studied, retaining of what he read chiefly the 
material which wove itself into his own thought. On the 
occasions when he f ound time for review, he notes especially 
the striking improvement in his imderstanding of the pas- 
sages as wholes. He notes occasionally his disagreement 
with the author he is reading. 

This set of notes shows much greater activity of mind on 
the part of the student than does the first set. He estimates 
values, organizes materials for use, and picks out ideas which 
interest him. But he works erratically and does not wrestle 
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with problems or cases in point. Economics as a subject 
seems less congenial to him than other subjects, for in 
Economics he suffers more from his tendency to "browse" 
in the subject rather than to concentrate his attention on a 
connected series of problems. 

Set 3 

Nimiber of records submitted — 71. 

This man studied m periods of considerable length, con- 
centrating on single subjects. He worked daily from 
December 10 to February 6, omitting Sundays and the full 
Christmas vacation. One record shows study in Social 
Ethics from i .-30 p. M. to 6 p. m. and the next record shows 
study in the same subject that evening from 7 p. m. to 2 a. m. 
This was reading and writing for a thesis and is recorded 
as "intensely interesting work." Periods of two and three 
hours are common. The work fell more often in the after- 
noon than in the evening. 

His method in Economics "is always the same: reading 
for impression, then making a brief." In general, he found 
his reading in Economics easy and sometimes interesting; 
but he evidently did it somewhat perfunctorily. His work 
on Immigration in Social Ethics 4 fascinated him. In this 
course his mind was generally active: he prepared for the 
examination by "considering possible questions and making 
answers for them/' a method which might seem like the 
most mechanical "cramming" if it were not for the evidence 
of the other records, which show that he was thinking for 
himself in the subject. His mark in the Course, (B— ), the 
highest he received, reflects this. In preparation for Eco- 
nomics A he read his notes through once and memorized 
diagrams and topic headings. 

His records give a general impression of application 
faithful enough, but never intensive except where personal 
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interest is aroused in connection with a piece of constnictive 
work. He is content to xinderstand what he reads, without 
any strong purpose to possess it, still less to ponder it as a 
matter of real concem — unless he can use it as part of his 
preparation for a theme or thesis. He is the sort of man who 
can best be awakened mentaUy by the pressnre of a practical 
problem or task, seldom by the mere exposition of faet or 
theory in book or lecture. 

Set 4 

Niunber of records submitted — 75. 

In Engineering Sciences 16 and Mathematics 2 b, both 
courses in which this student was registered during the fir st 
half of 191 2-13 and the second half of 1913-14, he spént 14 
hours of study, in all, from December 10, 1913, to February 
6, 1914. His final grade in Mathematics 2b was C—; in 
Engineering Sciences 16, A. In Mathematics C and Physics 
I he helped a f riend f our times, aggregating about 3H hours. 

Student 4 spent much less time in study than Students 
I, 2, or 3. He did no studying on seventeen college days 
during the period from December 10 to February 7, except 
for certain "outside" work during the Christmas vacation: 
thus he lost about 20 days out of 56. He sometimes studied 
early in the morning — on one occasion from 5 to 8; and 
often he studied in the forenoon between 9 and i. His 
longest consecutive study came in the evenings, often 
between 10 p.m. and i p.m., but in general his periods were 
short — usually half an hour or less. 

In Economics he just "reads," remarking once that the 
material is "interesting," but that he "will rely in the test 
more on his own reasoning than on the words of the text." 
He worked out volimtarily a few nimierical solutions for 
economic problems and found it "useful drill." Also he 
records "thinking out applications of the principles" pre- 
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sented in the text. Anything in mathematical or scientific 
form appeals to him, but in writing English themes his 
thoughts "do not come freely." In English 2 he foiind 
"writing out passages a great help in memorizing." In 
English 22 he "gets started" slowly, only once recording 
rapid work on a theme, when he wrote "an indignant attack 
on a theme read in class." He always carefuUy rewrites 
themes, but never takes notes on reading. He records that 
in beginning a book he always reads it through hiu-riedly 
first "for a general impression." 

This student's mind works practically: he does best in 
the face of problems, objects, figures, examples; and in 
discussion and exposition. This is indicated by such records 
as the folio wing: 

Date: Week of Dec. 29. Hours: 3:00-11:00. Flace: B. & W. 
Power Station. 

CommetU: I derived great benefit from this vacation work which 
will help me in my Engineering. I was able to see the application of 
what I had leamed in class. I found out a great many new things 
for myself and freely asked questions. The engineers were very kind 
and showed me what they could. I picked up a good idea of the gen- 
eral routine work and repair work. It was of much more value than 
a week*s work in class. I leamed a great deal which is never men- 
tioned in class. One oiler trained me on examination questions. I 
spent some time computing data about the engines. 

The contact with the men was of great profit as I believe that it 
is important for an engineer to know how work looks from the work- 
man's point of view. 

If you wish I would gladly report on other vacation work I have 
done which has helped me. 

Date: Jan. S, '14. Hours: 11:15-12 m. Place: 53 Dunster St. 

Material: Carhart's College Physics. Chapter on calorimetry. 

Purpose: Helping a friend prepare for exam. 

Meihod: Working and explaining problems. 

Comment: Helps me to keep my hånd in on work that I have 
finished and which I shall need in my Engineering. It is my habit 
to spend time helping my friends. I shall report that until you re- 
quest only my own work. 
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Dale: 1/8/ 14. Bours: 10:15-11:00?. m. Place: 53 Dunster St. 

Material: Carhart*s College Physics. Calorimetry. Dew point, 
Triple point Hnmidity. 

Purpose: Helping a friend. 

Meihod: Explained the text and enlightened dark piaces. Assisted 
with the problems by giving hints and suggestions, also made sure 
that he understood prindple. 

This work refreshed my memory of physical constants. Also it 
was good practice in exposition and clearing up misunderstanding. 
The Triple point was also new to me. I had to catch on to the ideas 
and explain after one reading of the text. Trains mental alertness. 

Date: 1/3/ 14. Hours: 2 :oo-2 -45 p. M. Place: Room. 

Maierial: Original thought. 

Purpose: Request from railroad fireman for explanation of 
"Linking up." 

Meihod: Developed engine cards from Zenner diagram; plotted 
work cards and torque of locomotive through complete cycle. 

Commeni: I j&nd original work like this of ten of much more value 
than class work. It is good practice in deduction from apparently 
unrelated facts. It develops reasoning power and confidence that 
when I do strike a problem that is not taken up in any text book I 
have seen, I stand a good chance of solving it. This increases re- 
sourcefulness. The results are often of great help in class and at 
work. 

(Note): Do you wish work that falls in no course to be reported? 

Date: 1/10/14. Hours: 11:00-11:15 P. m. Place: Home. 

Material: Original thought. 

Purpose: Proof that a three-phase current could be transmitted 
over three wires. 

Meihod: Derivation of formula. 

Comment: Very useful training. Makes me more independent of 
the text book. The suggestion came from a diagram of a three- 
phase current and three-phase transformer. The result is that I 
have a clear conception of what such a current is which I never shall 
forget. 

Date: 1/12/14. Hours: 9:00-10:15 p. m. Place: 53 Dunster St. 

Material: Class problems in projection of one line on another in 
space. 

Purpose: Helping a friend. 

Comment: Very good training and think quickly in working out 
problems. Knocks the rust off of my analjrtic geometry. 
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Date: 4/5/14. Hours: 9:00-12:0011. Place: Westmoreley 106. 
MaUrial: Friend's notes. 
Purpose: Exam. 
Method: Mutual explanation. 

Comment: I think this a very good way to prepare for an exam. 
Seminars of two or three sbould be gathered together to talk. 

Sets 

Number of records submitted — 80. 

Student 5 missed seventeen days out of 46, including 
eight days in the Christmas vacation. He used every hour 
of the day, from 8 a. m. to 1 130 a. m. His periods of study 
are of reasonable length, ranging commonly from three- 
quarters of an hour to two hours. 

This student was more intelligent and thoughtful than 

diligent. His comments show independence and critical 

power, but he does not do his work with great care or per- 

sistence. In Economics he "reads once" and "thinks over 

the important points." In Mathematics and Physics he 

works with a friend, doing problems, comparing notes, and 

asking or answering questions. In English he gets clear 

impressions from a single reading. He is frank in his 

criticism of books and chapters but takes the easiest way 

in study. 

Set 6 

Nimiber of records submitted — 34. 

This student missed 27 days out of 44, including the whole 
period (17 days) between December 18 and January 5. He 
studied in the af temoon and evening, seldom in the morn- 
ing. His periods are most of ten only twenty or twenty-five 
minutes in length. 

He slights Economics most, often reading a chapter in 
ten minutes. In reading he takes notes when he has time. 
He has no consdous method of study except in Spanish, in 
which he visualizes sentences in composition and leams one 
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sentence at a time in that way. His comments show that 
he takes study without much thought: if he understands at 
first reading he calls the period " satisf actory " ; if not, he 
remarks, "Too diflScnlt, so gave it up." 

Set 7 

Nimiber of records submitted — 30. 

Student 7 missed only two days, except for the period 
from December 19 to January 6, during which he did not 
study. He always studied in periods longer than an hour, 
usually for at least two hours — but many of these periods 
were in the laboratory. 

In Economics he reads hastily, and records that "it needs 
to be done over again." In other courses he tends to hurry, 
but checks himself , starts over again and goes more slowly. 
When he has objects or diagrams or specimens before him he 
is satisfied with his results, seldom otherwise. On one slip 
he remarks, conceming "original data on Coral Reefs of 
the Philippine Islands" of which he made a topical outline, 
"Fair. But I would like to return to the Philippines and 
see the reefs again!!" He is not conscious of his methods, 
but does his work steadily, in the handiest way. 

Sets 

Nimiber of records submitted — 98. 

During a period of 68 days this student did no studying 
on 23. (He was a married man, although an imdergraduate.) 
He of ten studied from 5 to 6 in the morning, and in general 
did most of his work in the f orenoon, none af ter 1 1 at night. 
Most of his periods are half or three quarters of an hour in 
length, although on the paper in Education A he worked 
continuously for six hours, and on his thesis for History i6a 
for f our and a half hours. 
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Student 8 was by far the most seK-conscious in his study- 
ing, of the men in this group. He tried various experiments 
— reading aloud, listening to reading aloud, abstracting 
before study and after study, choosing topic-words for a 
set of cards to be nm over at odd moments, making digests 
of notes taken by another man, testing his memory of topics 
chosen at random, thinking carefully on selected problems, 
visualizing vocabnlaries, etc. His best results came from 
the time he spent on organizing materials in outline form 
and fitting illxistrative details imder appropriate headings. 

These records give strong support to a common impression, 
namely, that college students are engaged for the most part 
in preparing for examinations, tests, and papers and seldom 
look beyond these imtnediate objecHves. The questions with 
which lectures and text books deal are not real to them. Their 
practical business at the moment is to "pass the course." 
Any and all methods and devices which can be used to make 
them f eel the reality and significance of the problems they 
are studying ought to be adopted, even at great risks. 

As to methods of study, the records show that students 
are largely innocent of any knowledge of the dififerent 
requirements of dififerent tasks. They seldom think out 
cases, problems, exceptions, contrary positions, applications, 
or corollaries. They try to imderstand, fix the material in 
mind, pick out the important points. Instruction in study 
is needed and specific directions for particular pieces of work. 

The evidence in this section agrees admirably with the 
evidence from the questionnaires, from our visits, and from 
other minor studies in supporting the general conclusion 
that there is great and imnecessary waste of time in college 
work. Much of it could be prevented by more careful 
attention on the part of instructors to the problems of 
teaching as such — not merely to modes of presentation in 
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class, but to the guidance of individtcals in their leaming. 
To make this possible, however, the University must first 
change its method of estimating the work a teacher ought to 
carry. The only just way to determine the burden of an 
mstructor who is to work individually with his student is 
to use as a imit the "student-hour," with such adjustments 
as the varying character of courses may suggest.^ 

II. Preparatory Questions in Economics A 

This section reports the only experiment in method in 
which we were able to secure quantitative retums of any 
sort, and in this case we should have been glad to conduct 
a more elaborate experiment to test the conclusions here 
reported. The other experiments we hoped to carry out, 
on two of which work was begun, are discussed in the 
following section. The experiments are reported not to 
present results of value in themselves, for they yielded none; 
nor to exemplify method in any of its refinements, for our 
method was only generally sound and the results should 
have been checked in a nimiber of ways; but to show the 
possibilities of experiment and the kind of questions it can 
be applied to. 

Professor Day had had in mind for some time the possible 
advantage of giving to students in Economics A questions 
and problems to be considered in advance of the reading, 
without any requirement of written reports on them, the 
questions being intended simply to sharpen the students' 
interest in their subsequent study. The results of this 
experiment were taken to support the use of such questions, 
and Professor Day and Dr. Davis later published their 

^ See Biige, E. A. " How Many Hours a Week Should be Required of Teachers 
in a University?" TransacUons and Proceedings of the National Association 
of the State Universities, v. 14, 1916. 
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volume of Questions in Economics in order to continue the 
policy. In 1913-14, preparatory questions were used in all 
sections of Economics A, and it was proposed in that year 
that after December 10 the use of these questions should be 
omitted in all but a few selected sections for the sake of 
testing in a new way the eflfect of their use. It was also 
proposed that the relative advantages of "scientific" and 
"popular" questions should be tested by using the latter 
with certain sections and the former with others. These 
proposals, however, could not be camed out satisfactorily, 
owing to lack of time. 

The following report on the methods and results of this 
experiment was presented at the joint conf erence on October 
29, 1913. 

Method and Results in an Experiment with Preparatory 
Questions in Certain Sections of Economics A , i gi 2-1 3 

In Economics A, the assigned reading is given out at the Saturday 
lecture. In the section meetings of the following week (Monday to 
Friday), the reading thus assigned is discussed. Each lecture covers 
the ground of the reading assigned on the previous Saturday. At 
the first section meeting of the week, a twenty-minute test on the 
reading and the lecture of the previous week is given. 

It seemed clear that a list of questions, given out before the as- 
signment of the reading and designed to stimulate the curiosity and 
challenge the interest of students, might make their reading more 
profitable and their comprehension and memory of it and of the lec- 
ture more complete. Such questions would constitute a device to be 
used in preparing the minds of the students for the facts and concep- 
tions presented in the reading and the lecture, and in arousing and 
directing their attention. Professor Day suggested that such ques- 
tions be given out in certain sections and not in others, beginning in 
February, 1913, and that the records of sections with which the ex- 
periment was tried be compared with the records of the control sec- 
tions throughout the spring and on the final examination. The 
results presented below show that in most cases the preparatory 
questions were of some profit in the preparation of the weekly papers; 
but the retums from the final examinations are variable and incon- 
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clusive. A few shiftings from section to section late in the second 
half year account for this in part; and the faet that the results in the 
examination differ so markedly from the results in the paper shows 
how sharply examinations and daily work are separated. It will be 
noted, however, that it was only Section M which forged ahead of its 
competing "favored" sections — a faet for whieh we found no ex- 
planation. The general experienee of the two instructors who used 
these questions was in favor of them, and a number of students ex- 
pressed their interest in the questions and their belief that they had 
been helped by them. 

The character of the questions used may be seen from the 
f ollowing examples : 

1. Rents in Harvard Square are lower than on Washington Street 
in Boston. Would you expect priees for the same artieles to be less 
at Harvard Square? Why or Why not? 

2. Is the existenee of a leisure elass supported from economie 
rent socially justified? Do you find any valid objeetions to state ap- 
propriation of all sueh rents? 

3. Wherein are rent and monopoly gains alike, wherein different? 

4. The total annual rental of a house and lot is $5000. The value 
of the house is $40,000. Repairs, depredation, and insuranee eost 
$1000 yearly. If the current rate of interest on investments of equal 
security is 5 per cent, what is the value of the lot? 

5. Is the spendthrift a public benefactor , in that he increases the 
demand for labor? 

6. What is meant by the "discounted marginal product of labor"? 

7. What is the cause of the declining birth rate in advandng 
countries? Would this cause operate under socialism? 

8. Are the rich becoming richer, and the poor, poorer? 

9. Can tråde imions increase general wages? 

10. What is meant by "charging what the traffic will bear"? 
Would you expect the railroad rate on a ton of copper to be higher or 
lower than the rate on a ton of coal? Why does an express company 
charge no more for carrying 25 Ibs. of books than it does for carrying 
the same distance at owner's risk 25 Ibs. of table silver? 

11. Enumerate all the public service Industries you can think of. 
Will the distribution of milk ever become a public service industry? 

12. What is unfair competition? Is the f ollowing imfair competi- 
tion? — To ref use to sell to any retailer who will carry rival lines of 
goods? 
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Pkofessor Day's Sections 

Sect. E Sect. K 

Mid-Year Examination . 60.4 65.3 

Paper 68.2* 70.9 

68.8 75.9* 

" 71.6* 73.3 

" 75.5* 76.8 

Average 71.03 74.23 

Final Examination . . . 69.9 73.5 

* Given preparatoiy questions. 



Favorable 
effectof 
Difference Prep. Questions 


4.9 




2.7 


2.2 


7.1 


2.2 


1.7 


3.2 


1.3 


3.6 


3.2 


2.8 


4.6 


.3 



Mk. Bukbank's SEcnoNS 



Mid-Year Examination 
Paper 



Average .... 
Final Examination 



SectD 
62.6 
70.1 

58.5 
65.7 
72.6 

69 

73.2 
68.18 

68.04 



^ect. HL 

59.1 

65.5 

56.7 
63.2 

68 

64.7 
68.1 

64.37 
71 



Favorable 
effectof 
Difference Prep. Questions 



35 
4.6 

1.8 

2.5 

4.6 

4.3 
5.1 
3.82 
2.96 



i.i 

1.7* 
I. ♦ 

I.I 

.8 

1.6 

.32 
6.46* 



In each case the preparatory questions were given to Section D. 

* Unfavorable 



Mk. Bukbank's SEcnoNS 



Mid-Year Examination 
Paper 



Average .... 
Final Elxamination 



Sect. G 
60.3 

69.3 
56.7 
69.2 

70.1 

67.5 
72.6 

70.3 
67.96 

67.15 



Sect. P 

65.3 
70.1 

58 
68 

73.8 

73.1 
71.8 

69.7 
69.21 

7044 



In each case Uie questions were given to Section G. 

* Unfavorable. 



Favorable 
effectof 
Difference Prep. Questions 



5 

.8 

1.3 
1.2 

3.7 
5.6 

.8 

.6 
1.26 

3.29 



4.2 

3.7 
6.2 

1.3 
.6* 

5.8 

5.6 

3.74 
1.71 
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Mr. Bukbank's SEcnoNS 



Mid-Year Examination 
Paper 



Average 

Final Examination . 



Sect. D 
62.6 
70.1 

58.S 
65.7 
72.6 

69 

73-2 
68.18 

68.04 



Sect. P 

65.3 
70.1 

S8 
68 

73.8 

73-1 
71.8 

69.21 

70.44 



In each case the question was given to Section D. 

* Unfavorable. 



Favorable 
effectof 
Difference Prep. Questions 



2.7 

•S 

2.5 
1.2 

4.1 

1.4 
I.18 



2.7 

3.2 
.2 

1.4* 

4.1 

1.72 

.3 



Mr. Burbank's Sections. 



Mid-Year Examination 
Paper 



Average .... 
Final Examination 



Sect. G 

60.3 

693 
56.7 
69.2 

70.1 

67.5 
72.6 

70.3 
67.96 

67.1S 



Sject. HL 

S9.I 
65.5 
56.7 
63.2 

68 

64.7 
68.1 
69.2 

65.57 
71 



In each case the question was given to Section G. 

* Unfavorable. 



FavOTable 
effectof 
Difference Prep. Questions 



1.2 
3.8 

6 

2.1 

2.8 

4.5 
1. 1 

3.85 



2.6 

1.2* 
4.8 
.9 

1.6 

3.3 
.1* 

1.7 
5.05' 



Average favorable effect on the papers, 2.81 in 24 cases, 
imfavorable " " " " j. 5 cases, 

favorable " " " final examination, .77 in 3 cases, 
imfavorable " " " " " 5.75 in 2 cases. 






The results of this experiment were not in themselves con- 
vincing as to the advantage of preparatory questions, yet 
they have some weight in corroboration of the general 
observation and opinion of the instructors. The only 
possibility of systematic error in the marking lay in the 
temptation which the instructors might have felt to give 
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higher marks to the students in the sections using prepara- 
tory questions. But the marks on the papers and on the 
final examinations were not given, of course, to the students 
of the various sections as groups, but as individuals, and it 
seems imUkely that any unconscious tendency to mark the 
students of one section higher than those of another could 
have exerted an influence strong enough to overcome 
conscientioxis eflfort to assign marks accurately. For the 
comparisons, a broader basis than the average standing of 
sections in the mid-year examinations should have been 
secured; and the preparatory questions should have been 
used for a considerable period with one section and then 
with the other. 

III. Proposals for Experiment in Method 

The first proposal for experiment in method was made 
in February, 19 13. Economics A was then concemed with 
the subject Interest, and it was agreed that in one section 
the students should omit reading the passages in the text 
and instead look over the financial sheet of the morning 
paper to find the rate of interest and what quotations give 
the clearest indication of it. On the basis of this more or 
less practical contact with the facts of the matter, discussion 
was to bring out the principles necessary for a completer 
understanding of the topic. In another section the usual 
procedure was to be followed, and the performances of the 
two sections on the subsequent class paper were to be 
compared. The more inductive procedure, starting from 
the study of facts presented in a way already partly f amiliar 
to most of the students, might, it was thought, yield better 
results by aroxising greater interest and attention. The 
results of this experiment were to be combined with the 
results of similar experiments with inductive teaching, in 
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each case a "contror* séction giving the necessary basis 
for comparison. Unf ortunately, a mistake in the assignment 
of the work made it impossible to compare the performances 
of the two sections on Interest, and the experiment with 
preliminary questions took most of the time we could give 
to this phase of the investigation thereaf ter. 

The next fall, however, an attempt was made to conduct 
an experiment in the leaming of a set definition. At a 
conferencé of instructors and assistants in Economics A, it 
was agreed that three of the men in charge of sections shonld 
attempt an experimental determination of the value of the 
carefnl leaming of a fixed definition. Each of these in- 
structors agreed to teach the definition of Marginal Utility 
in certain sections and not in others. The procedure agreed 
upon was as follows: The general conception was to be 
discussed in class in the usual fashion by question and 
answer, but before the close of the hour the instructor was 
to ask for the definition of Marginal Utility y and this was 
to be put on the board. The definition as given was to be 
criticized and corrected and the definition agreed on by 
the instructors was to be substituted on the board for any 
less adequate definition suggested by the students. The 
definition as prsented by the instructors was to be leamed 
by heart by the students and their exact recall of it tested 
in a subsequent section meeting. The advantage of this 
procedure was to be compared with the advantage of teach- 
ing this topic without the leaming of a set definition, by 
means of a question to be answered in the fall hour-examina- 
tion. This experiment failed because the instructors did 
not succeed in saving time enough for the teaching of the 
definition. Only one foimd himself in a position even to 
report his results. 

Experiment in college teaching demands a great deal of 
time and close attention to detail. There are so many 
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possibilities of error, means of control are so diflScult to 
apply, and conclusive tests so hard to devise, that some 
experience, to say nothing of time, energy, and purpose, is 
necessary to carry an experiment to a profitable conclusion. 
We believe this can be done, however, and that in many 
cases in which the value of a particular method is in dispute 
it would pay to attempt it. There is no good ground, to be 
sure, for the hope that experiment in this field can be made 
so exact as to banish forever all possibility of difference of 
opinion. The complexity of the action to be controlled, 
the impossibUity of eliminating hiddeH factors, and the 
barriers to observation of results are all such as to make 
dubious the expectation of final conclusions based solely on 
experiment. Yet the effort to secure returns more exact than 
those of unrecorded and unchecked observation cannot but 
yield a valuable result. It will at any rate sharpen observa- 
tion and concentrate attention on problems of teaching 
which are now too often entirely ignored. It is evident 
that the arrangement of sections in Economics A oflfers a 
particularly good opportunity for exact comparison of the 
results of dififerent modes of procedure in the class room. 
Many of the policies and devices contained in the list of 
Section II of the chapter on Method might be tested by 
controlled experiment in these sections. We would suggest 
as especially profitable fieids for experiment in method the 
f ollowing : 

(i) The use of devices other than preparatory questions 
for arousing interest and curiosity in advance of class dis- 
cussion, reading, or the lecture on a given topic. Discussion 
in class and the assignment of reading in current newspapers 
and magazines might bring even better results than the use 
of printed questions. 

(2) The presentation in class of the materials and at 
least the beginning of the process of memorizing them under 
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the direction of the instructor, in cases where figures, graphs, 
terms, etc, are to be leamed from visual impressions. 

(3) The use of reports from students, brief debates, 
questions and problems framed by the students, and other 
devices for securing participation by the class as a means 
of assuring complete imderstanding of a generalization, 
principle, or complex situation, with which the class should 
be made thoroughly f amiliar. 

(4) The use of at least one practical project or investiga- 
tion of considerable extent in the course of the year as a 
means of giving to students a fuller imderstanding of the 
nature of economic facts and principles. 

IV. Proposal for a Fundamental Test 

One of the first proposals of the Inspection was the 
f ormulation of a general test by which growth in ability to 
handle economic data and solve economic problems might 
be measured. It seemed to us not impossible to secure a 
set of questions, or better still, several alternative sets, 
comprehensive enough to cover most of the main fieids of 
economic inquiry and diflScult enough to test the ability of 
advanced students, yet presenting problems of such common 
interest and general importance that even the beginner 
might attack them with some measure of comprehension. 
Such a set of questions could not be used, of course, as an 
ordinary examination, since the answers to them might be 
leamed in advance if it were known that they were to be 
given more than once. A test of this sort would be useful 
only as a measure of the increase of general ability in the 
subject resulting from any given amoimt of study of eco- 
nomics or any particular phase of it. It would be essentially 
an instrmnent of investigation. 

Obviously, the questions to be used in such a test would 
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have to be tried first in section meetings or examinations in 
several of the conrses in order to discover their availabil- 
ity for this particular purpose. Questions which could be 
answered with complete success by a large proportion of the 
students at the end of the introductory course would not be 
suitable, nor would questions too diflScult even for relatively 
advanced students. Questions to which the answers would 
necessarily be overlong and hard to grade would not do; 
for an essential requirement of the test would be that retums 
from it could be graded with considerable accuracy. For 
this reason, and also for the obviously necessary purpose of 
excluding problems on which economists are still too largely 
in doubt, it would be necessary to exclude questions which 
could not be carefully analyzed for the accurate grading of 
answers. These requirements make the formulation of a 
fundamental test a time-consuming and difficult task. We 
could not delay the other phases of the Inspection in order to 
seciu-e a large number of questions and to prove their value 
for this piupose. In consequence, only one question was 
tested by giving it in a section meeting in Economics A and 
again in the final examination. Professor Day, however, 
handed in a number of questions which he considered 
promising for use in the test, and some of these are presented 
here, together with the results of the two examinations in 
Economics A, on which the first question was set. 

The character of the questions submitted by Professor 
Day as possibly suitable for a fimdamental test may be seen 
from the following examples: 

1. To what extent and in what manner do the following contribute 
to the formation of capital: a miser; a postal savings bank; a life In- 
surance Company; govemment borrowing; a manual tndning school 
teacher; a college professor? 

2. In what respects is the wide extension of the corporate organiza- 
tion of industry advantageous, in what respects disadvantageous, for 
(a) the business man? (b) the investor? (c) the conmiunity at large? 
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3. What part, if any, do commerdal banks play in (a) the process 
of investment? (6) the increase of capital? {c) the course of industrial 
development? (d) leadership in the business world? In what re^pects 
may the influence of commerdal banks be undesirable? 

4. By what process, if at all, should you expect the following to 
influence the general price level in the United States: (a) advertising; 
(6) the growth of the trusts; (c) increasing demands of trade-unions; 
{(i) extravagant purchases of automobiles; (e) increased output from 
South African gold mines; (/) wider use of deposit accounts in France? 

5. Explain the parts played in the course of industrial crises and 
depressions by (a) distributing middlemen; (6) finandal middlemen; 
(c) the accumulation of fresh savings; (d) extensive crop failures; 
(e) an increasing gold supply; (/) the failure of an important indus- 
trial incorporation; (g) an extension of govemment interference with 
the conduct of business. 

6. In the case of urban sites, what are the arguments for and 
against state appropriation of (a) all economic rent? (b) all future 
increases of economic rent? (c) part of future increases of economic 
rent? 

7. Should taxation be used as an instrument for (a) appropriating 
illegitimate incomes? (6) restricting undesirable business practices? 
(c) absorbing monopoly profits? (d) redudng inequalities of wealth? 

For what other objects may taxation be employed? 

8. Give the arguments (a) from the viewpoint of the trade-unionist, 
(6) from the viewpoint of the economist, for and against 

1. the closed shop; 8. a standard rate of wages; 

2. the open shop; 9. semi-military disdpline by em- 

3. the closed union; ployers; 

4. the open union; 10. the "scab"; 

5. labor-saving appliances; 11. the strike; 

6. limitation of output; 12. the lockout. 

7. piece-work; 

9. How is industrial leadership affected by (a) the diffusion of 
education? (6) freedom of opportimity? {c) inequality of possessions? 
(jt) inmiaterial rewards? 

10. Upon what grounds, if any, are the following to be condemned 
or justified: (a) the right of inheritance; (6) the institution of pri- 
vate property; (c) the leisure class? 

The question set in the regular class meeting of Econoinics 
A for October 18, 1913, and repeated on the final examination 
in June, 1914, was as follows: "'The principle of protection 
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is to build up our home Industries by manufacturing oiu* 
own products. This gives oiu* people employment, keeps 
the money in the coimtry, and makes this coimtry an inde- 
pendent and self-reliant nation.' Wherein are these argu- 
ments valid? Wherein invalid? Give your reasons." 

The answers to the question were to be graded accord- 
ing to the foUowing analysis of the elements a correct 
answer was expected to contain. 



Analysis 

Question parts: 

1. The prindple of protec- 

tion is to build up our 
home industries by 
manufacturing our 
own products. 

2. This gives our people 

employment. 



3. Keeps money in the 
country. 



FOR Grading Answers 

Weight 
Answer parts : given : 

1. The prindple ofprotection not .o2j^ 

necessaiily confined to man- 
ufacture. May apply to 
agriculture, for example. 

2. Protection does not increase .30 

employment, but simply 
changes the direction of 
industry. 

3a. This involves the falladous .20 
notion that all importations 
are paid for in money. Of 
course only international 
balances are settled in 
spede. 

b. High protection may cause a .02^ 

somewhat greater share of 
the world's monetary stock 
to remain in the country. 

c. The statement implies that .12H 

money is peculiarly desir- 
able or in a spedal sense 
"wealth." This, of course, 
is erroneous. A large stock 
of money is, in general, no 
gain; it simply means the 
use of a greater number of 
oounters. 
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d. Thext may be a alight gaia, j02% 
however, in the purdiaæ of 
foreign commodities pro- 
duced on a Iower price 
level. 

4. And makes this country 4a. Self-suffidency is no more .25 
an independent and an economic goal among 

self-reliant nation. nations tban amtmg indi- 

viduals. Division of laber 
is desirable, for it leads to 
the adaptation of industry 
to economic advantage. lii 
other words, nations will 
produce those commodities 
in the production of wMch 
they have the greatest com- 
parative advantage. 
b. Military self-suffidency may .05 
perhaps be justified on poltt- 
ical grounds. 

One hundred and twenty-two answers to this question 
OD the papers written in October were carefully corrected 
according to the above analysis by the staff of Economics 
A and the grades given are compared below with the grades 







Grades in Jote 

»0 30 40 50 60 7Q 80 QO I 


TotaU 






a 




7 


7 


?■ 


13 





2 


I 


47 


rtS.ita 










-I 


6 


.S 


8 








3S 


S0.49 


2 ^° 
8 40 

5 i 


I 






4 


I 


a 


,S 


,1 


S 


I 


2T 


17-Jl 


I 






I 




3 


4 


a 


t 




I^ 


10.66 




I 








I 


I 


2 








4-Qi 














1 


i 








,1.28 


9 70 














3 


I 


t 


I 


6 


4.g* 


























90 


















































Totals 


a 


.1 


13 


n 


•4 


1.1 


.IS 


10 


8 


3 


III 




% 


1.64 


»46 


9.84 


10.66 


11.48 


10.66 


28.69 


IS-S7 


6.56 


M6 







MINOR STUDIES AND EXPERIMENTS lOI 

received by the same men on this identical question in the 
final examination in Jime, 19 14. 

The table shows, as might be expected, a general shifting 
toward the higher ranks ; but it shows also that the question 
thus tested would be fully available for such a list as was 
proposed. The question proved difficult for beginners, yet 
not too difficult, since 61 per cent of the October answers 
could be graded 10 or above. It also proved sufficiently diffi- 
cult for the majority at the end of the year, for almost half 
(57) of the men received a final grade lower than 60. In 
continuation of this experiment it would be interesting to 
give the same question to students in higher courses in the 
Department, both during the fall and at the end of the 
year. 

V. Examination Questions 

According to the statements made by the instructors of 
the Department, which for convenience of reference are 
summarized below,^ two clearly defined aims characterize 

1 Instructor 

B . . To think clearly, and form a rational condusion; development of the 
power to analyze ... to orient oneself , and keep one's bearing in the 
midst of the varying winds of doctrine; to reason consecutively. 

F . . I. Training in assimilation of facts (to put men in possession of the 
principal facts). 
2. Training in critical analysis, 

G . . I. Survey of the subject at large (information). 

2. Train men in thinking and reasoning {independent tkinking), 

3. Better dtizens. 

4. Training in investigation (advanced course). 

E . . Perspective and background through information (historical course), 

and in addition, questions which devdop power of rekUing information* 
D . . Analysis of materials, methods of presentation; acquaintances with 

courses. 

To weigh carefully; reason cogently; more capadty for comprehension 

and analysis. 

To teach students to analyze. 
C . . "To cultivate by practice the analytical faculty and judgment" 

To consider "analytically a faet lo as to find out its elements or its 
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practically every course in the Economics Department: 
(i) the impaxting of a certain amonnt or sort of information; 
(2) training in the ability to analyze, to relate facts, and to 
reason. By some it is implied that this is a general training, 
but for the most part it is specified that the training is in 
handling the particular body of facts presented in the course. 

In addition, a third aim is assigned in some of the advanced 
courses, — namely, training and guidance in independent 
thinking and investigation. There are one or two other 
aims stated, as for example, that of preparation for citizen- 
ship. 

The examination questions given in these courses ofifer 
one way of estimating in how far their aims are actually 
realized. If it is intended to train students in reasoning, 
for example, the examination questions should be tests of 
their ability to reason. They should demand not simply a 
memory of how others have reasoned about these situations, 
but actual independent reasoning and thinking. With this 
question in mind, the examination papers in the various 
courses were inspected to determine what proportion of 
the questions in the examination papers call for information, 
and what proportion demand specifically analysis and 
reasoning. 

The questions have been divided roughly into two 
classes, — "memory" questions and "reasoning" questions. 

significance, and the relation of the discovered faet to other facts 
either obvious or derived." 

"Memory plays ahnost no part in the work. Only analysb and judg- 
ment will accomplish anything." 
To cultivate the power to analyze a business situation. 
A . . General knowledge of prindples and their applications, and the real 
meanings of the study. 

As much knowledge as possible of prindples and the application and to 
Train students in methods of investigation and reasoning ... to get 
men to think for themselves. 
Acquaintance with literature. 
"To impart information, to teadi men to think and to investigate." 
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"Memory" questions were considered to be those that 
involved merdy a statement of faet or opinion evidently 
developed in lectures, required reading, or sections. "Rea- 
soning" questions involved expressions o£ opinion on the 
part of the student, organization of data in the examination 
room, analysis of new situations, and relating information 
to economic theory. 

Some of the questions classified under "reasoning" doubt- 
less demand simply memory of reasoning done in class or by 
the instnictor, and probably others demand merely the 
memory of a formula, the rest being the somewhat mechani- 
cal appUcation of it; but it would not be possible to decide 
in these cases without a very intimate knowledge of the 
courses in question. On this accoimt there is doubtless more 
"memory" work demanded on the examinations than the 
results reported below would indicate. 

Ten examples of questions which were considered to call 
primarily for memory and ten which were considered to caU 
for reasoning are listed below.^ 

* "Memory" Questions 

1. "The standard of living affects wages not directly, but" — how? 

What evidence of varying standards of living appears in the statistics of births 
and deaths for dififerent countries? for dififerent social dasses? 

2. Under what conditions does inconvertible paper money drculate as readily 
as specie? Under what conditions, not as readily? 

Under what conditions is the value of inconvertible paper money as great as 
that of specie? Under what conditions is its value less than that of spede? 

State two indications of its having less value than spede. Which of the two 
is the more significant? Which ia the more easily ascertained? 

3. State points of similarity, points of difference, between the Federal Reserve 
system and the English hanking system as regards (a) centralisation of reserves; 
(6) centralization of note issue; (c) measures available for preventing panics. 

4. (a) How was the capital for the construction of railroads prior to 1870 
obtained in the dififerent European countries? Why? 

(6) Why was the railzoad policy of Prussia modified after 1870? With what 
results? 

5. Compare the English and Belgian methods of reKeving the recent agricul- 
tural depression. 
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Fifty-one examinations, both mid-year and final, set in 
the following courses during the years 1912--1913, 1913- 

6. Give an account of the main developments in the London money-mariLet 
from the outbreak of the War until the end of February, 1915. 

7. Ezplain: "puts"; ''bonowing and carrying"; stock-exchange clearing 
house. Discuss the relations of the Stock Exchange and the banks in New Yoik. 

8. Compare the views of Mill and Ross as to the limits of social control. 

9. What, according to Ross, is the relation of resentment to social worker? 

10. What is sabotage? 

"Reasoning" QuEsnoNS 

1. Construct a simple index number of prices for 19 14, iising 1908 as the base. 
(A) Would the index-number point to a rise or a fall in the value of money? (B) 
Would a Board of Arbitration be justified in reconmiending a change in wages? 
If so, on what basis? If not, why not? 

2. Explain briefly the inmiediate and the ultimate effects (if any) which each 
of the following changes, taken separately, will tend to have on the price of cotton, 
cotton-seed oil, and cotton-miU machinery; (a) prohibition of organized specula- 
tion; {b) a change of fashion toward greater use of cotton fabrics; {c) doubling 
of the population of the country. (Assume for all three cases that there is no 
international tråde, and that the quantity of money remains the same.) 

3. In what direction and by what process, if at all, would the following tend 
to affect the value of money in the United States: (a) increased demand for gold 
ornaments; (b) increasing lavish expenditiures by ^>endthrifts; (c) a continued 
drain of specie to the East; (d) a larger output of silver in the United States; 
(e) abolition of all legally required banking reserves? 

4. Outline briefly your views as to the inmiediate influence of the Civil War 
on (a) land policy, (b) banking, (c) tariff, and {d) industrial progress North and 
South. 

5. "Surpluses have spelled disaster to the United States." Do you agree? 
When and how? 

6. Assiuning the laws of the United States to remain unchanged, how would 

our monetary stock be affected if the market ratio of gold and silver should be- 
come 18 to i; 15 to i; 12 to i? 

7. In Austria, "af ter 1870, — the value of paper money with respect to silver 
steadily rose until, in 1878, it reached parity with silver ... In 1879, t^e free 
or private coinage of silver was stopped." Consider whether, after this action, 
the (i) silver pieces, and (2) the paper notes were commodity, credit, or fiat 
money? Had Austria not closed the mints to the free coinage of silver, how would 
the following have been aflected in that coimtry: (a) the monetary stock; (b) the 
monetary standard; (c) the value of money? 

8. Explain or iUustrate exactly what you understand by self-interest. 

9. Outline a program for raising the wages of all the lower grades of labor. 

10. Would the following appear on the income sheet or on the balance sheet? 
Under what name in either case? 
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1914, and 1914-1915, were included in the study: A, i, la, 
2a, 2b, 3, 4a, 4b, s, 6a, 7, 8, 9, II, 12, 13, 14, 24, 31, 32, 33. 
The results were as f ollows (in percentages) : 



Instructor 


Coone 


''Memoiy" Questions 


"Reasoning" Questions 
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12 


88 
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17 


83 
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47 
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78 


22 




c 


60 


40 



The above table gives the proportions in the final examina- 
tions only. Certain mid-year papers were also examined 
as f ollows (in percentages) : 

Total of Mid-Year 
Memory Reasoning and Final 

Questions Questions Memocy Reasoning 

Instructor G . . . . 46 54 48 52 

Instructor D . . . . 55 45 46 54 

Instructor A , . . . Z7 84 3Z 69 

Conclusion: There are discrepancies here and there 
between the statement of the aims of the instructors and 

(a) Cost of a patent bought. 

(h) Rent for storage of new machinery ordered from different firms and de- 

livered at dififerent times, but to be installed together, as soon as Hl arrives, 

in a new shop. 
(c) Author's royalty on a copyrighted story printed and distributed in an ez- 

tended advertising campaign. 
((O Cost of heating during permanent interior decoration of a new store. 
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the evidence fumished in the examination questions. The 
latter, of course, do not provide an altogether sufficient 
criterion on which to judge, but it is to be noted that, in the 
main, there is agreement between the statement of aims 
of the instructors and the kind of questions set in the 
examination papers. This is notably so in the case of 
Instructor C. 



CHAPTER V 

THE QUESTIONNAIRES 

I. CONSTRUCTION OF THE QUESTIONNAIRES 

DuRiNG the fall of 1914 provisional questionnaires to 
graduatesand to studentsweredrawn up and submitted to the 
Department of Economics. A joint committee later put these 
questionnaires into final form, and they were sent to alumni 
in Febniary 191 5 and given out in classes early in March. 
The questionnaires read as f oUows, the larger printed form 
aUowing ample room for repUes: 

I. Questionnaire to graduales 

Hasvasd Univessity 

Division of Education — DeparimerU of Economics 

Dear Sir: 

The Department of Economics has invited the Division of Educa- 
tion to invesdgate the undergraduate instruction in Economics with 
a view to its improvement. This set of questions is sent out by the 
Division of Education with the approval of the Department of Eco- 
nomics. The Department of Economics joins the Division of Educa- 
tion in requesting that you give the questions your careful attention 
and mail this sheet in the endosed envdope by March — . Your 
answers will be recdved by the Division of Education and will be 
treated as confidential by that Division if you so desire. 

Yours truly, 

The Department of Economics^ 
The Division of Education. 

1. Name. Class 

2. Address. 

3. Occupation. 

107 
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4. On the foUowing page, please list the conrses in Economics 
you took at Harvard and make some statement conceming 
their subsequent value to you. Have the courses proved 
valuable (a) in your vocation, and if so, in what way? 
(b) in your social, civic, or economic activities outside your 
vocation, and if so, in what way? (c) in other, more general 
phases of your life, and if so, in what way? Please feel free 
to make your statement in your own terms; if you cannot 
specify as to courses, but can make a general statement con- 
ceming your work in Economics as a whole, please do so. 



Courses Year Statements 



5. Can you ascribe any of these values to a particidar part or re- 

quirement of a course — as, for example, to a certain book 
assigned, lectures on a particidar topic, a particidar method 
of presentation or of study, or a particular thesis requirement? 

6. In what way would a different treatment of any of these courses, 

either as to subject matter or as to method, have made it 
more valuable to you? 

7. Is there any aspect or fidd of Economics which you now wish 

you had studied in college? Please indicate, in particular, 
such subjects as you desired to study in college but did not 
find offered in the programme of the Department. 

8. What suggestions or criticisms, general or specific, have you to 

offer? 

2. Questionnaire to students 

Harvard University 

Division of Education — Department of Economics 

The information cailed for below is desired in order that the courses 
in the Department of Economics may as far as possible meet theneeds 
of the students. You are requested to give the data cailed for as fully 
as you are able. Your answers will be received by the Division of 
Education, and will be treated as confidential by that Division. The 
answers will not be shown to instructors in Economics without the 
permission of the writers. 
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Please mail this sheet in the accompanying envdope not later than 
March 00. 

1. Name. 

2. Address. 

3. Candidate for what degree? 

4. Class? Underline: 1915, 1916, 1917, 1918. 
Graduate School of Arts and Sciences? Year. 
Graduate School of Business Administration? Year. 

5. Indicate the courses you have completed in the Department 

of Economics: 



Course 



Year 



Grade 



Course 



Year 



• ■ • • 



• • • • 



Grade 



6. What courses are you now taking in Economics? Do you in- 

tend to take others? 

7. What is your field of concentration? 

8. In what field, if any, are you a candidate for the A.B. with 

distinction? 

9. What is to be your vocation after graduation? 

Do you expect your study of Economics to hdp you in that 
vocation? How? 

10. What are your general reasons for studying Economics? 
What were your spedfic reasons for choosing particular courses? 
On what information and advice, if any, did you select your 

courses in Economics? 

11. What courses in the University, outside the Department of 

Economics, have you found most hdpful in your study of 
Economics? Why? 

12. What difficidties have you met in your study of Economics? 
Please reply frankly and spedfically, indicating any lack of 

fadlities, disadvantageous arrangement of requirements in 
reading or thesis writing, lack of supervision in your work, 
or other obstade to progress. 
If you have found any course disappointing, please name 
it and tell why, in your opinion, it did not meet your 
needs. 

13. Mark in order (i, 2, etc) the foUowing phases of the work 

according to their relative he^fulness to you, beginning 
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with the most hdpful: lectnres; dass discussions; assigned 
reading; reports; essay writing; laboratory exercises; com- 
ments or additional information. 

14. Do you find your instruction in Economics related to the 

problems you meet in life? How? 
Are you interested in any particular movement or problem of 
theday? What? 

15. What added suggestions or critidsms, general or spedfic, have 

you to oflFer? 

The replies were satisfactory in nnmber and almost 
without exception careful and serious in character. Since 
the value of any answer, criticism, or suggestion made in 
response to a questionnaire depends very largely on the 
eamestnesSy standing, and character of the ene who responds, 
it seemed best not to try on most of the points to secure data 
which could be håndled statistically. Coimting votes is 
not an especially profitable way in which to secure guidance 
in dealing with a technical problem. The drift of c^inion^ 
however, was in this case, as it is in others, worth knowing, 
and the simmiaries given below show the drift of opinion on 
a number of important matters. Yet if any suggestion or 
criticism is to be assessed at its proper value, the records of 
the men who make it must be known; and for this puipose 
(since it was obviously necessary to promise that the replies 
themselves should be received in confidence) the data from 
aU the replies were entered on large sheets so that anyone 
interested might f oUow any reply across the various colimms, 
get its general tenor, discover the courses taken and grades 
eamed by the individual thus responding, and such other 
pertinent facts as his vocational purpose, or his reasons for 
taking courses in Economics. 

The criticisms and suggestions from alumni conceming 
particular coiu*ses were recorded on a special set of cards and 
spedfic mention of individual instructors on a separate 
sheet. These special data and the large sheets mentioned 
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above are in the hånds of the Department of Economics.^ 
This chapter deak soldy with questions of some general 
importance. 

n. The Returns 

A. Replies from Alumni 

1. The number of replies received was 330, out of a possible 
thousand — a proportion reasonably gratifying in view of 
the somewhat formidable character of the questionnaire, 
and a total quite sufficient for safety in drawing conclnsions. 
Twelve of the replies were not included in making the simi- 
maries which f ollow, either because the writers had taken no 
conrses in Economics or because their answers were not 
pertinent. The summaries are based, therefore, on 318 
replies. 

2. The dasses in which the men were grouped ranged 
from 1880 to 1913, as follows: 

ClaM NnmbcrofMen QaM Number of Men 
1S80 Z 1904 4 

1890 3 1905 36 

1891 43 1906 34 

1893 I Z907 z6 

1894 13 1908 3 

1896 II 1909 18 

1897 I 1910 9 

1899 9 191X 3Z 

1900 I 1913 35 ' 

1901 13 19x3 30 

1903 60 

Total 318 

3. The standing in the community of some of the writers 
was suggested by the faet that their names were foimd in 

^ la order to lecure data on wptd&c ooutks dow (1916-17) actually in opera- 
tion, the Department of Eoonomks has iflsued a teoond questioiiiiaire to under- 
graduates, framed in light of our erptnokct with the questionnaares here diacussed. 
The returns from this seoond list of questions are available, and so far as they are 
of general interest may be secured from the Department 
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"Who's Who in America" for 1914-15. Seventeen of the 
318 writers were included in the records of this pubUcation. 

4. The degrees received by the writers are shown in the 
f oUowing list : 

BaccalaureaU Degrees 

A.B 308 

A.6. without distinction 158 

A.B. cum laude 87 

A.B. magna cum laude 53 

A.B. summa cum laude zx 150 

S.B 10 

Higher Degrees 

A.M 56 

Ph.D 21 

L.H.D I 

M.D IS 

LL.B 71 

M.E I 

M.E.E 2 

S.T.B 6 

S.T.D I 

M.F 3 

M.BA 2 

Mus.B I 

The group as a whole is therefore highly respectable, 
academically speaking. 

5. The occupations of the writers are shown in the f oUow- 
ing table. There is a slight overlapping due to the faet that 
a f ew men gave more than one occupation. 

Older Professions 

Thelaw 74 

Teaching 46 

Medierne 15 

The ministiy : 7 

142 
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Technological Professions 

Engineering iz 

Naval engineering i 

Mining geology i 

Forestry i 

Chemistry 3 

Architecture S 

22 
Btisiness 

Manufacturing 18 

Management 9 

Fidudary positions 12 

Banking and brokerage 22 

Real estate and insurance 8 

General commerce 13 

Advertising 3 

Publishing 4 

Transportation 3 

Bookkeeping 3 

Buyingy selling 6 

Undassified i 

102 
AgrictUture, etc, 

Farming 8 

Horticulture i 

9 
Journalism 

Newspaper or magazine work 8 

Other OccupcUions 

Art 2 

Study 16 

Secretarial work 6 

Statistics 3 

Public service S 

Scientic work ' 3 

Not given 7 

6. The courses in Economics taken by the writers appear 
in the f ollowing list : 
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EaxKnnics I (now A) ooly 82 

EcDDCMiiics I and other coimes 232 

Other coimes only 4 

Midd]e-gnnq> oourses 175 

Upper-groiq> couises 21 

Undassified 38 

7. The valnes assigned to instruction in Economics are: 



(a) VocaUonal values fotmd by 135 men 

(b) Social and civic values found by 84 

(c) General values found by 205 






The retums on this point are considered in greater detail 
below. 

8. The parts of the wark which the men mentioned favor- 
ably or unfavorably were: 

(a) Lectures, of which 31 men speak favoiably 

although 9 men speak unfavorably 

(b) SecUon meetings , of which 20 men speak favoiably 

although 20 men speak imfavorably 

(c) TheseSf of which 33 men speak favorably 

although 4 men speak unfavorably 

9. The methods singled out for special mention by more 
than one man were : 

(a) The method employed by Professor Taussig in Economics 2 

This method is variously referred to as the Socratic, the quiz, and the 
dass discussion method. It is spedfically and favorably mentioned by 
II men. 

{h) The method employed by Professor Carver in Economics 3. 

This method is referred to as the discussion method and is favorably 
mentioned by 6 men, although i other did not find it inspiring. 

Case and class discussion methods are mentioned favor- 
ably, but not in connection with any particular course, by 
10 men. One man, however, considers the case method 
unsuited to imdergraduates. Sixteen men speak favorably, 
in a general way, of quizzes or of other ways in which 
participation by students in class work may be secured. 
Many insist on small classes and persona! contact with the 
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professor. Four lay stress on the great advantage of thesis 
work. Of two otliers who speak favorably of theses, one 
thinks they should be required often and short; whereas 
the otlier would require only f ew theses, on the ground that 
their preparation demands much time and attention. One 
man would require a thesis in Economics A. Three speak 
favorably of the written tests and papers. 
IQ. The assistants are mentioned as foUows: 

Favorably by 7 men 

Unfavorably by 31 " 

Other replies which cover section meetings and the work 
of assistants together are summarized more completely 
below. 

11. The courses men wish they had taken were: 

1. Accounting 20 men 

2. Banking 19 

3. Sodology 12 

4. Business Administration 12 

5. Transportation 10 

6. Labor Problems 8 

7. Foreign Exchange 6 

8. Commerdal Law 5 

9. Economics of Agriculture 3 

xo. Foreign Tråde 3 

11. Financial Grises 3 

12. Tariflf 2 

13. Statistics 2 

12. Suggestions and criticisms were offer ed by a large 
proportion of the writers, and may be summarized in part as 
f oUows : 

a. Lack of practical application was mentioned so many 
times that it must be listed as a major critidsm. 

In all, this critidsm is made or directly implied by 63 men 

The opposite view was held by i 



Further analysis of the suggestions under this head is 
made in a later part of this Section« 
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Specific suggestions were : 

1. More fiequent reference to current events suggested by ... . 30 men 

2. Closer study of labor unions suggested by 6 " 

3. Fuller training in elementary bookkeeping as a preparation for 

the course in Accounting suggested by 5 " 

4. The study of modem sodological problems suggested by 2 " 

5. Visits to Boston banks suggested by 2 " 

6. Lectures by successful business men on their spedalties .... 2 '' 

7. Admission of undergraduates to courses in the Business School 
suggested by 2 " 

8. The study of stock exchange methods suggested by i man 

9. Investigation of actual business methods suggested by .... x " 
10. The study of investments suggested by i " 

b. Miscellaneous suggestions and comments may be listed 
as f ollows : 

1. Greater opportunity for contact with professors suggested by . 6 men 

2. More general courses in Economics at the expense of spedalized 
courses suggested by 5 " 

3. The treatment of economic theories as less fixed than has hereto- 

fore been the custom suggested by 4 " 

4. Diminution of memory work in favor of development of thought 
suggested by 4 " 

5. Fuller guidance in the selection of courses suggested by ... . 3 " 

6. Making some study of Economics compulsory suggested by . . 3 " 

7. Provision for direct practical training for definite work suggested 

by 2 « 

8. The teaching of methods rather than facts suggested by ... . 2 

9. Vocational guidance in college suggested by 2 

10. Requirement of more written work suggested by 2 " 

XI. More collateral reading suggested by 2 " 

12. More careful selection of reading and better correlation with the 
lectures suggested by 2 " 

13. Closer correlation of section meetings and lectures suggested by i man 

Strong commendation of courses in Economics and the 
methods of instruction in vogue in the Department is not 
infrequent, and most of the answers imply satisfaction with 
the instruction in one way or another. Eight men speak in 
especially high terms of the courses given during their time. 

13. On the values assigned to the instruction, to section- 
meetings and assistants, and to the practical applications of 
the instruction, more elaborate analyses were made. 
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The Value oj Ecanomics Courses to Lawyers and Jtuiges 

Of this group 18 took Economics i only, 12 took two 
courses, and 42 took three or more courses. Nineteen were 
graduated before 1900, 36 between 1899 and 1908, and 27 
from 1908 to 1913, inclusive. 

Value in Vocaiian 

Number Per Cent 

Number of replies considered ....*. 72 — 

Decidedly advantageous in vocation . . 7 10 
Favorable comment, moderate or uncer- 

tain statements 21 29 

Vigorous adverse comment 2 3 

Adverse, less vigorous comment .... 3 4 

Totals: Advantageous 28 39 

Of slight value if any .... 5 7 

No comment 39 54 

Social or Civic Value 

Number Per Cent 

Number of replies considered 72 — 

Decidedly helpful in these req>ects. . . 6 8 
Favorable comment, moderate or uncer- 

tain statements 13 18 

Vigorous adverse comment 3 4 

Adverse, less vigorous comment .... 2 3 

Totals: Courses helpful 19 26 

Of slight value if any .... 5 7 

No comment 48 67 

General CuUural Values 

Number Per Cent 

Number of replies considered 72 — 

Decidedly helpful in theae itspects, . . 9 13 
Favorable comment, moderate or uncer- 

tain statements 41 57 

Adverse comment z z 

Totals: Favorable comment .... 50 70 

Adverse comment z z 

No comment sz 29 
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Variatis Valnes Mentianed in Different Replies 

A considerable number stated directly or implied by their 
answers that it was difficult to name specific values which 
had resulted from the conrses taken. They felt that they 
had been helped m various ways but were unable to discover 
tangible results or give concrete examples. Fourteen (20 
per cent) made definite statements to this effect. 

Eighteen (25 per cent) thought that they had been helped 
in forming their opinions on current questions aside from 
political issues. Nine (13 per cent) were better able to 
decide political questions. 

Mental discipline or general training of the mind is evi- 
dently considered an important result by many of this 
group. Eleven (16 per cent) make explicit mention of this 
point. 

Eight (11 per cent) had formed habits of logicai thought 
and careful investigation which were of assistance in their 
law practice. The method of Economics 2 was often 
alluded to as being especially valuable in this particular. 
Accoimting was regarded by 7 (10 per cent) as being a 
subject which had proved of practical value in keeping their 
own accoimts and in imderstanding the cases with which 
they dealt. Three (4 per cent) regarded the study of 
banking as having similar values. One spoke of the course 
in transportation as having been of practical assistance. 
Four (6 per cent) had a better imderstanding of busi- 
ness and corporate matters by reason of having taken 
Economics courses. 

Nine (13 per cent) regarded the courses taken as being 
a valuable introduction to the field of economics, and 7 
(10 per cent) were stimulated to do further private reading 
and study. Four (7 per cent) spoke of the courses as 
having "cultural" value. Three (4 per cent) mentioned 
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being better able to understand matters about which they 
read in newspapers or magazines. Three (4 per cent) had 
been stimnlated to think more thoroughly on all subjects. 
Three others were able to converse more intelligently on 
economic subjects. Two felt that they were better able to 
grasp the work of the law school. One regarded the subject 
matter as "valueless" but had received some benefit in 
other ways. 

Quotations from Lawyers on Valnes of Cour ses in Vocation 

The degree granted from Harvard or other universities is 
noted in each case. If some special office is held, mention is 
made of the faet. Nmnbers refer to courses taken. 

No. 16. A.B. (magna cum laude) LL.B. A.M. Class of 
1 89 1. Economics i and two others. Judge of Juvenile 
Court. 

I cannot say that any of these courses have been of direct 
value to me in my vocation or in my sodal, dvic, or economic 
activities, but I consider all my work imder Professor Taussig 
of great value to me in making up my mind as a voter on eco- 
nomic issues, and in my general imderstanding of the social 
order and the essence of wealth, the real function and nature of 
money, and the relation between capital and labor. 

No. 56. A.B. A.M. Class of 1891. Economics i and 2. 
Department of Agriculture, Washington, D. C. 

The chief benefit I got, especially from the study of economic 
theories, was the mental discipline. I also received some in- 
delible impressions which have ever since afifected my point of 
view and method of approaching economic and public ques- 
tions. . . . Except for the past two years, I have engaged con- 
tinuously since 1894 in the general practice of law. It is only 
fair to say that one engaged in such an occupation is apt, at 
some time, to find use for every type of information; this is as 
true of one who devotes himself largely to giving advice to 
clients as of one who partidpates much in the trial of litigated 
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cases. . . . My contact with Mr. Brooks and my studies 
under him have, I feel sure, given me a much more sympathetic 
attitude toward social questions, such as general unrest, labor 
unions, and co5peration, than I would have had otherwise. . . . 
I can still hear Mr. Taussig talking and promoting controversy 
and discussion. I am sure that I was aided in my power of 
analysis, in the development of my capacity to weigh evidence 
and to balance off arguments, and in the growth not only of 
willingness to do, but of unwillingness not to do my own think- 
ing. I prepared a thesis or special report for Mr. Brooks on the 
Farmers' Alliance Movement which was helpful to me in de- 
vising methods of getting data and in arriving at an imderstand- 
ing of a particular problem. 

No. 228. A.B. (cum laude) Class of 1891. Econoniics i, 6, 
and 2 (half year). 

In trying land damage cases in court, I find that the subject 
of real estate values and rents is illiuninated by what I leamed 
in this course. (Economics i). Business and affairs are the 
practical matters with which the activities of most of us are con- 
cemed; the courses in politicai economy lie doser to our later 
work than any other courses excepting possibly the English 
composition courses. The general discussions in class led by 
Professor Taussig were most interesting and helpful. They 
were more valuable than thesis writing. The latter is chiefly 
research work which has no permanent value different from the 
research work done in history or other courses. 

No. 22g. LL.B. Class of 1912. Economics i, 3, 18, 4, and 
2B. Social Ethics i. 

The real value from a course comes from the ability of the 
instructor to interest the student enough to do more than the 
required work and to continue study of it after college. Both 
Professors Carver and Gay sent me away feeling that I had 
been introduced to a subject worthy of f urther development; 
Professor Cole's course completed the training for one who does 
not become an expert accoimtant and has been of great value 
in several ways, especially in that the language of the business 
world is not Greek to a college man. The course in sociology 
was very instructive and of great value to a lawyer. 
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No, 67. A.B. LL.B. Class of 1906. Economics i, 6, 8a, 
8b, 18, and 21. 

Of these courses, by far the most useful since graduation was 
Mr. Cole's course on Accoimting. I cannot speak too highly of 
it. Professor Sprague's Economics 6, Financial History of the 
United States, and Economics 8a and 8^, Money and Banking, 
were interesting and instructive, but I have not found the in- 
formation gained in them of any real value in the practice of 
law. Economics 21, on Business Law, I have always regarded 
as time wasted. 

No. 106. A.B. (ciim laude) LL.B. Class of 1907. Eco- 
nomics I, 6, 8a, 8b, 12b, 23^, 23^, 12a. Treasurer. 

Except for Economics 21, I do not value the courses on the 
basis of subject matter. In all of Mr. Carver's courses the 
greatest value was foimd in watching his mind work. Every de- 
velopment was so absolutely mathematically correct. ... All 
courses in college were to my mind developers and the acquisi- 
tion of miscellaneous information a mere chance which might as 
well occur in general reading as in a course. ... I desire to 
raise a query as to the concrete benefits of courses on special 
subjects. For instance, the course on corporations is undoubt- 
edly a wonderful course, but outside of the men who went to law 
school and leamed it all over not one in fif ty can state a single 
faet in the laws of corporations in restraint of tråde. It did 
however grease a lot of heads which had done no previous think- 
ing. The title caught the subjects but the course produced the 
results and the Sherman Aet did not. 

No. 270. A.B. (magna cum laude) LL.B. Class of 1909. 
Economics i and 2. 

These two courses taken together constitute a general incur- 
sion into the subject and fximish a good working knowledge of 
economics which I believe to be a necessary part of a lawyer's 
equipment. These courses . . . have fiunished a basis upon 
which I can rely in acquiring such special knowledge in a par- 
ticular part of Uie subject as may from time to time be needed; 
for example, foreign exchange during the last summer, or anti- 
trust matters in relation to the Sherman and Clayton Acts. 
Economics 2, in its conference method of presentation, is a 
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most excellent mental trainmg. I f oimd it very helpful in pre- 
paring the way for a similar presentation of law in the law 
school. 

No. lyg. LL.B. Class of 1907. Economics i, 4, 5, 9b, 6a, 
6b, 8a, 8b, 11, 7a, 7b, 18, and 21. Deputy Attomey 
General (State). 

The courses have been of imdoubted value to me in my law 
practice, both in general practice and while representing the 
State. They gave me an imderstanding of the methods of 
business and general principles on which business should be 
carried on. They gave me a training in method of study, valu- 
able in law school and in practice, espedally in how to evolve 
general rules from concrete facts. In general practice, aside 
from technical practice rules (e. g. Evidence, Code Pleading), 
in giving advice, especially in corporation matters, I foimd that 
the knowledge acquired gave me a dedded advantage over other 
men of my age who had not studied much economics. As part 
of a liberal education, they have been of value to me in my 
political activities, and socially, by enabling me to comprehend 
and discuss intelligently questions of govemment and other 
questions of general interest. 

No. lyy. A.B. (magna'cum laude) A.M. LL.B. Class of 
1901. Economics i. 

Of no perceptible value in my vocation. Certainly an addi- 
tion to general knowledge in understanding the meaning of 
terms, names of theories, and exponents of theories. In dvic 
activities (such as City Club of New York, Department of 
Public Charities, etc), a lawyer naturally contributes the 
special professional knowledge he has whidi others may not 
bring, and in such specialty I cannot see that theoretical eco- 
nomics plays any valuable part. Of course an aid in pleasant 
intercourse with fellow-men, like any other bit of knowledge; 
nothing more, discemibly. 

No. yi. A.B. (cum laude) LL.B. Class of 1909. Eco- 
nomics I, 5, 9b, 2, 6b. 

I think that the courses on the general subject are essential 
to a well roimded education. They are of real cultural value. 
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I have f ound none of the courses valuable in my profession ex- 
cept in the very broadest sense. There is a course in Account- 
ing which I bdieve is listed in the Department of Economics 
which I regret not having taken. This is a course which I 
think numbers of my profession will agree is of great practical 
value to them. 



The Valtie of Economics Cour ses to Manufacturers 

Of this group 7 took Economics i only, 2 took only two 
courses in the Department, and 9 took three or more courses. 
Five were graduated before 1900, 2 between 1899 and 1908, 
and 2 from 1908 to 1913, inclusive. 

Valtie in Vocation 

Number Per Cent 

Number of replies considered i8 — 

Decidedly advantageous in vocation . . 3 17 

Favorable comment, moderate or uncer- 

tain statements 7 39 

Unfavorable comment o o 

Totals: Advantageous zo 56 

Of slight value if any .... o o 

No comment 8 44 

Social or Civic Value 

Number Per Cent 

Number of replies considered 18 — 

Favorable commenti moderate or uncer- 

tain statements 3 17 

No conmient made 15 83 

General CuUure Valnes 

Nomber Per Cent 

Number of replies considered 18 — 

Decidedly helpful in these itspects. . . 3 17 
Favorable comment, moderate or uncer- 

tain statements 9 50 

Totals: Favorable 12 67 

No conmient made 6 33 

The answers from this group were very brief as a mie and 
it seems likely that the questioimaire did not receive as much 
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attention from the manufactnrers as it did from the lawyers. 
For this reason it appears probable that the same weight 
shonld not be given to the tabnlation of replies as wonld 
otherwise be expected. 

Four (22 per cent) make no comment on the benefits de- 
rived from their courses in Economics. Four mention that 
they have foimd the information of value in business affairs. 
Four were helped in deciding political issues or questions of 
public economic policy. Three (17 per cent) foimd the 
courses a stimulation to thought on economic subjects and 
three others felt that the principles laid down had formed 
the basis of their later thought. Two (11 per cent) speak 
of the course as having been valuable mental discipline. 
Two more regard their courses as a general introduction 
to the field of economic reading and thought. One man 
speaks of being sufficiently interested to do f urther reading, 
and another was helped in the comprehension of the terms 
used in tråde journals and in conversation with business 
men. One believes that the specific facts were of no 
value to him, although he derived other benefits from the 
courses. 

It is significant that none of the manufactnrers mention 
the course in Banking as having been of practical value, 
although three took the course. Of five who took Ac- 
coimting, two mention it as having proved valuable. 
One speaks in high terms of the coiurses on railroads and 
two of commercial law. 

Quotaiions from Manufacturers on the Value of Economic 

Courses 

No. 148. A.B. (magna cum laude) Class of 1912. Eco- 
nomics I, 2, 6a, 6b, 7, 18, and 9. 

The principles with which I became acquainted in the various 
courses in Economics which I took in collie have formed so 
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fundamental a part of my general line of thought that they have 
undoubtedly greatly influenced me in business and been of 
value to me in every aspect of my life. . . . The work of Eco- 
nomics 18 and that of the courses in Business Law have been of 
concrete service in every business matter with which I have had 
to do. 

No. 187. A.B. Class of 1903. Economics i. 

The course has not been of value in my vocation. It has in- 
creased my interest in and imderstanding of dvic questions 
through belief in the need of sodological-economic reforms. It 
has not been valuable in more general ways. 

No. 2g3. A.B. (cum laude) A.M. Class of 1903. Eco- 
nomics I, 8a, and 8b. 

I consider that the courses in economics have been of real 
substantial value; in particular in giving a better imderstanding 
of the broad questions related to them which come up both in 
business life and as questions of public economic policy. I do 
not consider the spedfic facts as of particular value, but f eel that 
the imderstanding which they give of the deep imderljdng prin- 
dples, however imperfect it may be, gives a real basis for better 
judgment and foresight on the private questions of one's own 
business policy as well as public matters. 

The Value of Economics Cour ses to Physicians and Surgeons 

Of this group 6 took Economics i only, 6 took two courses, 
and 3 took three or more courses. Eight were graduated 
before 1900, and the remaining 7 between 1899 and 1908. 

Value in Vocation 

Number Per Cent 

Number of replies consklered 15 — 

Favorable comment, moderate or uncer- 

tain statements i 7 

Deddedly adverse coimnent i 7 

Adverse, less vigorous comment .... x 7 

Totals: Favorable conmient x 7 

Of slight value if any .... 2 X3 

No comment made xa 80 
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Social or Civic Values 

Nnmber Per Cent 

Number of replies cmisidered 15 — 

Deddedly hdpful in these itspects, . . 2 13 

Favorable comment, moderate or uncer- 

tain statements 5 33 

Totals: Favorable comment 7 47 

No comment made 8 53 

General Ctdture Values 

Nnmber Per Cent 

Number of replies considered 15 — 

Deddedly helpful in these itspects. . . 3 20 

Favorable comment, moderate or uncer- 

tain statements 8 53 

Totals: Favorable comment ix 73 

No comment made 4 27 

Eight (53 per cent) speak of the courses as valuable in 
"broadening one's education," as a "contribution to general 
cultnre," or as giving "general training and knowledge." 
Five (33 per cent) were helped to a better understanding of 
social questions and 5 others were better able to form 
an opinion on political issues. Three (20 per cent) had 
a clearer insight into financial operations, which they 
considered of value. Two had found the conrses in 
Banking helpful. One had been helped in his general 
reading, another in ordinary conversation, and a third 
considered the conrses a part of a valuable f oundation for 
his later studies. 

Quotations from Physicians 

No. 3og. A.B. M.D. Class of 1896. Economics i and 7. 
Hospital Superintendent. 

These courses have been of value in helping me solve some of 
my medical problems, as quite a portion of my work has been 
in connection with the poor or working people. Espedally is 
this true of Economics i. 
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No. 72. A.B. (cum laude) M.D. Class of 1899. Eco- 
nomics i and 6. 

Economics 6 gave me a knowledge without which I could not 
have properly understood many of the contemporary govem- 
mental problems. The thesis I wrote on the Merchant Marine 
has been of value in late years in coaching school debates and 
in friendiy argtiments since the war broke out. All in all, I 
consider it one of my most valnable courses. 



The Valtie of Economics Courses to Editors^ Journalists y 

and Newspaper Men 

Of this group 3 took Economics i only, 2 took two or 
more courses, and 5 took three or more courses. Three were 
graduated before 1900, 3 between 1899 and 1908, and 4 
between 1908 and 1913, inclusive. 

Value in Vocation 

Number Per Cent 

Number of replies considered zo — 

Deddedly advantageous in vocation . . 2 ao 
Favorable comment, moderate or uncer- 

tain statements 4 40 

Deddedly adverse comment 2 20 

Adverse, less vigorous comment .... 2 20 

Totals: Favorable comment 6 60 

Slight value if any 4 40 

Social ar Civic Values 

Number Per Cent 

Number of replies considered 10 — 

Deddedly helpful in these respects. . . z 10 
Favorable comment, moderate or uncer- 

tain statements 3 30 

Totals: Favorable 4 40 

No comment made 6 60 

General CuUure Values 

Number Per Cent 

Number of replies considered zo — 

Deddedly he^ful in these respects. . . z zo 
Favorable comment, moderate or uncer- 

tain statements 5 50 

Totals: Favorable conmient 6 60 

No comment made 4 40 
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Three regard their courses as having "oiltural" value and 
3 praise "mental training" and "methods of study." Two 
were given a broader outlook which they considered valuable 
to a writer and 2 felt that their interest had been awakened 
in certain economic problems. One had foimd the course in 
Accoimting of practical assistance. One had been helped in 
finding material, and another regarded his courses as a good 
foimdation for fnrther study. 

QuoUUions from Journalists ^ Editors ^ etc. 

No. 2^6. A.B. (simmia ciun laude) Class of 1907. Eco- 
nomics i, 14a, and 14b. Bureau of Education, Wash- 
* ington, D. C. 

I still consider Economics i probably the most valuable course 
I took in college. For my present work in survejdng the general 
educational field it was indispensable. . . . The opportunity to 
get different points of view, as represented by different men — 
Taussig, Andrews, Ripley, etc. — was espedally valuable. 

No. igi. A.B. Class of 1903. Economics i, 6, 9, 18, and 
21. With . . . and Company, educational publishers. 

Courses 9, 18, and 21 have all been valuable in my vocation. 
Economics 9 gave me an unprejudiced view of the labor problem 
before I came in contact with the view of the employer. 18 was 
valuable because in executive work I have constant need to know 
the meaning of accoimts, how to construct them so as to show the 
actual condition of business, and how to interpret them. The 
study of cases in Economics 21 was good mental drill and training 
for business lif e. The case method gave me a good idea of what 
the common law is and how an attomey gæs to work to make 
up his case. All my courses in Economics were among Harvard's 
most valuable contributions to my "liberal education." 

The Valne of Economics Courses to EducatorSy Professors ^ 

Teachersy and Ministers 

Of this group 18 took Economics i "only, 10 took two 
courses, and 24 took three or more courses. Thirteen were 
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graduated before igcio, 26 between 1899 and 1908, and 13 
from 1908 to 1913, inclusive. Nine were professors of 
Economics. Four (8 per cent) made no comment on the 
value of the courses to them. 



Vdue in Vocation 

Number Per Cent 

Number of replies considered 52 — 

Deddedly advantageous in vocation . . 8 15 
Favorable comment, moderate or imcer- 

tain statements 10 19 

Vigorous adverse comment 2 4 

Adverse, less vigorous comment .... 3 6 

Totals: Advantageous 18 35 

Of slight value if any .... 5 10 

No comment made 29 56 

Social or Cimc Values 

Number Per Cent 

Number of replies considered 52 — 

Deddedly helpful in these respects. . . 4 8 
Favorable comment, moderate or imcer- 

tain statements 14 27 

Deddedly adverse comment i 2 

Adverse, less dedded comment .... i 2 

Totals: Favorable comment 18 35 

Of slight value if any .... 2 4 

No comment made 32 62 

General Culture Values 

Number Per Cent 

Number of replies considered 52 — 

Deddedly helpful in these respects. . . 6 11 
Favorable comment, moderate or uncer- 

tain statements 28 54 

Vigorous adverse comment i 2 

Totals: Courses helpful 34 66 

Of slight value if any . . . . i 2 

No comment made 17 33 

The replies from this group are usually very brief and 
many of them are imsatisfactory because the statements 

tend to be very general, sometimes uncertain in meaning, 
and are rarely concrete or objective. 
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Fifteen (29 per cent) found their courses helpful in form- 
ing opinions on political issues. Eleven (21 per cent) were 
helped in solving social problems or in conducting sociolog- 
icai investigations. Several of these were ministers. Eleven 
(21 per cent) felt that new interest had been aroused in 
questions of which they were previously ignorant, or that 
their outlook had been broadened. Six (12 per cent) were 
better able to xmderstand "current economic problems." 
Eight (15 per cent), who were not teachers of Economics, 
had gleaned information from the courses which had been 
usefxil in presenting their own work in schools or colleges. 
Among those who used such information, one was teaching 
EngUsh, one Agriculture, and another History. Five (10 per 
cent) spoke of having received training in reasoning or in 
critical thinking (mental discipline). Four (8 per cent) 
mentioned "cxiltural values." Fonr others were better able 
to xmderstand business affairs or had received a "general 
training which was useful in the business affairs of life." 

Three (6 per cent) regarded their study of the subject as 
having provided the basis for much of their present trend of 
thought or as having altered their outlook upon life. Three 
were led to do f urther reading or were stimxilated in a desire 
for "more cxilture and information." Two regarded their 
courses as a general introduction to the field of economics. 
Two mention the course in Accoxmting and one the course 
in Banking as having been of material assistance in practical 
affairs. 

Qiwtations 

No. 151. A.B. (cimi laude) A.M. LL.B. Class of 1906. 
Economics i, 2, 3, 6, 12b, and 16. Lecturer on economic 
subjects. 

Economics 2 in particular was extremdy stimulating to 
critical thinking. A certain amount of Economics is absolutdy 
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essential ... to show the superfidal but cocksure ignorance 
of the average successful lawyer or biismess man in discussing 
public affairs. 

No. 24. A.B. (cum laude) A.M. Class of 1901. Eco- 
nomics i, 5, 6, 7, 9, 17, and 20. Education. Adminis- 
tration. 

The course in Accounting has been of great practical value 
both during a year and a half in a raikoad office and since in 
School Administration. Some scraps of information have been 
valuable in my teaching but my real profit from the courses was 
through personal association with men like Ashley, Dunbar, 
and Taussig. I consider my work in Economics cultural and 
not vocational. It was the historical courses that I valued most 
highly. 

No. 81. A.B. (cum laude) A.M. Ph.D. Class of 1901. 
16 courses in Economics. Assistant Professor of 
Economics. 

The courses I took at Harvard have been of value from the 
point of view of content and training in the work. They awoke 
or strengthened my interest in the subject, and of course greatly 
influenced my whole outlook on life. It is not easy to distin- 
guish in other ways between this preluninary training and the 
work I have done since. 

No. 141. A.B. Class of 1894. Economics i. Minister. 

No course taken in college has proved more valuable. For 
twenty years I have been active in social, dvic, and labor work. 
As a minister and social worker I have many times been thank- 
ful for the elementary training in economic reasoning afiForded 
by Economics i. 

No. 250. A.B. (ComeU) A.M. 1905. Ph.D. Several 
courses in Economics. Associate Professor of Sociology. 

Natiu'ally the courses taken have been of direct value to me 
in my work as a teacher. Quite as naturally, perhaps, I find 
them of direct use in my activities as a dtizen. Tliey give added 
interest in following politicai and social movements. 
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The Valne qf Economics Cour ses to Business MeUj Induding 

Bankers, Brokers, Merchants j Clerks, Salesmenj 

Advertisement Writers, BuyerSj and 

Insurance Agents 

Qf this group lo took Economics i only, lo took two 
courseSy and 32 took three or more coiirses. Twenty-one 
were gradxiated before 1900, 20 between 1899 and 1908, 
and II from 1908 to 1913, inclusive. 

Value in Vacaiicn 

Namber Ptt Cent 

Number of rq>lie8 considered 52 — 

Decidedly advantageous in vocadon . . 6 12 
Favorable comment, moderate or uncer- 

tain statements 22 42 

Vigorous adverse comment 3 6 

Adverse, less vigorous comment .... 2 4 

Totals: Helpful in vocation 28 54 

Of slight value if any .... 5 10 

No comment made 19 37 

Social or Civic Value 

Number Per Cent 

Number of replies considered 52 — 

Helpful in these respects 12 23 

No comment made 40 77 

General Culture Valnes 

Number Per Cent 

Number of replies considered 52 — 

Decidedly helpful in these respects. . . 4 8 
Favorable comment, moderate or imcer- 

tain statements 29 56 

Totals: Favorable comment 33 64 

No comment made 19 37 

Fourteen (37 per cent) found Accoxmting a highly valu- 
able subject. Several suggest that this course should be 
compulsory for those who expect to be business men or 
lawyers. Four think that the course might have proved 
very much more helpful if it had been conducted in a diflfer- 
ent way. (See Suggestions on Economics 18.) Five (10 
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per cent) speak of the work on banking as having proved 
of practical assistance. Four (8 per cent) were helped by 
courses on railroads or transpor tation. Six (12 per cent) 
mention "valuable mental training" or say that they were 
helped to think in a "practical way." Six (12 per cent) 
were better able to form correct views on cnrrent economic 
questions. Five (10 per cent) mention social problems and 
seven (14 per cent) speak of political issues in the same 
way. Four were able to gain a foothold in business with 
less difficxilty because they understood technical terms and 
xmderlying principles. Five regarded their coiirses as having 
paved the way for more general reading and study along 
economic lines. Three were better able to find articles or 
look up data bearing on the problems which they had to 
solve. Foiir valued the courses for a broad outlook upon the 
business world. Three had gained a conception of the 
underdeveloped resoiirces and possibilities of futiire growth 
of the United States which had helped them in business. 
Only two valued their courses as part of a liberal education. 
One had been helped in managing the economic affairs of 
his household. 

Quotations 

No. 186. A.B. Class of 191 1. Economics i, 5, 18. Bond 
Broker. 

The courses in Economics have proved more valuable to me 
than all the rest of my college course. The course in Railroads 
afifects me directly in my business. Economics 18 is of the ut- 
most value to me, and I refer to Mr. Cole's book often. These 
courses teach you to think in a more practical way than any 
other subject can and they give you a foothold in any business. 

No. 24Q. A.B. Class of 1913. Economics i, 6a, 6b, 18, 
and others. Fruit Grower. 

Out of six or seven courses in Economics, I got nothing from 
any particular requirement, but rather gained a broader out- 



134 THE TEACHING OF ECONOMICS 

look on lif e through the greater field of vision gained from the 
whole course. . . . My biLsiness calls for planting trees on 
hitherto unbroken ground. Many people have said that I 
would get discouraged, that it could not be done profitably, 
etc. ... I believe that every Harvard man who has takén 
any courses in Economics or Philosophy gets and always 
keeps with him an imagination, an outlook on life that 
always gives him hope and courage to be able to find a way 
to do anything. 

No. 8. A.B. Class of 191 1. Economics i, 8a, 8b, 18, 21, 
and 23. Citrus Fruit Grower, Califomia. 

Economics i was possibly of some help in labor problems, 
possibly of help in understanding public questions. ... I was 
able to make considerable use of Economics 18 in revising the 
cost accounting on the ranch and expect to get a lot more help 
in the future in the same line. . . . Courses 8a, 8b, 21, and 23 
have been of Uttle if any practical value except that I f eel that the 
general mental training in seeing things from a broader economic 
viewpoint is often of considerable indirect value. 

Valtie of Economics Cour ses to Farmers and Foresters 

Of this group i graduated before 1900, 2 between 1899 
and 1908, and 6 from 1908 to 1913, inclusive. Two took 
Economics i only, i took two courses, and 6 took three or 
more courses. 

Value in Vocation 

Number Per Cent 

Number of replies considered 9 — 

Deddedly advantageous in vocation . . i 11 
Favorable comment, moderate or uncer- 

tain statements 5 56 

Totals: Favorable comment 6 67 

No comment made 3 33 

Social or Cimc Values 

Number Per Cent 

Number of replies considered 9 — 

No comment made 9 100 



>>^U^- : . V . 



QUESTIONN AIRES 135 

General Culiure Valnes 

Number Per Cent 

Number of replies considered 9 — 

Deddedly helpful in these respects. . . i 11 
Favorable comment, moderate or uncer- 

tain statements 5 56 

Totals: Favorable comment 6 67 

No comment 3 33 

Two found the courses valuable because they gave a new 
Outlook upon lif e and enabled the student to see things from 
a different point of view. Two were helped in solving 
political problems and 2 had received valuable mental 
training. One regarded the courses as part of a general 
education, one had been helped by xmderstanding the laws of 
tråde, and one had made good use of the course on Accounting 
(Economics 18). 

Valiic of Economics Courses in Various Vocations 

I n m IV V VI vn 

|,| il -Li il Is I III is il 

Vocational 39 56 7 60 35 54 67 

Social-Civic 26 17 47 40 35 23 22 

General Cultnre .... 70 50 53 60 66 64 67 
Forming Opinions on 

Political Issues ... 13 22 33 o 29 14 22 
Social Problems, Current 

Economic Questions . 25 17 17 20 21 12 o 
Habits of Thought; 

Mental Discipline . . 16 11 o 30 10 12 o 

Accounting 10 11 o 10 4 37 11 

Banking 4 o 13 o 2 10 o 

Further Reading an4 

Study 10 6 7 10 6 10 o 

Number in the Group . 72 18 15 10 52 52 9 

Notes: Groups in, IV, and VII are too small to admit of any important æn- 
clusions from the results. The subjects tabulated are pomts explidtly mentioned 
in the replies as values resulting from the courses and do not indude inferenæs 
which might readily be drawn in many cases from the nature of the replies. 
Figures represent percentages of total number of replies from the given vocation. 
The colunms do not total 100 per cent becauæ the headings overlig in aeveral ways. 
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Section Meetings and Assistants 

Fif ty-three men comment on the section meetings or the 
assistants. Thirty-two of these criticize the assistants or 
the method of conducting the sections. Nineteen make 
favorable comments and 2 speak favorably of the section 
meeting but adversely of the assistants. Many of those who 
criticize the section meetings most severely express them- 
selves as on the whole favorable to the idea. Their comments 
are usually aimed at the method of conducting the meetings 
or at the assistants rather than at the system itself . In 
many cases general statements are made conceming the 
ineflfectiveness of the sections without specifying what the 
defects were. 

Seven believe that the instructors were so engrossed in 
their graduate studies or other work that they did not take 
the time to do the necessary amount of reading on current 
economic questions. Seven make mention of the faet that 
the assistants were impractical or limited in point of view. 
Five replies insist that more experienced men be placed in 
charge of the sections and 4 point out that the assistants 
lacked teachmg experience. 

Eight think that more time shoxild have been taken for 
discussion on the part of the students. Only one man says 
that the discussion drove home the points touched upon in 
the lectures and stimulated an interest in the weekly assign- 
ment of reading. Two say that the section meeting was 
conducted as a means of finding out whether the prescribed 
reading had been done, and 2 others believe that there was 
much wasted efifort in memorizing the work in a certain order 
due to the mechanical questions asked. Two think that the 
papers were graded as "task jobs" by the assistants and 
were not given proper consideration. Two suggest that the 
discussions were not properly correlated with the lectures. 
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Two regard the section meeting as a waste of time because 
a large group had frequently to wait whilé attention was 
given to an individual whose difficulties were not common to 
the others. 

Two say that their instructor was of xmusual ability, one 
that the papers were fairly and carefnlly marked, and one 
that the debate was foxmd helpful. 

Quotations 

No. 226. A.B. (siunma cimi laude) Class of 1905. A.M. 
Economics i, 2, 5a, 5b, 6a, 6b, 8a, 8b, 9, etc. Efficiency 
Expert, Manufacturing. 

An extension of class discussion under the guidance of a 
master of his subject would drive the prindples of the several 
courses more deeply into the students' minds. The section- 
meeting system does not answer this purpose. All honor to the 
Austin Teaching Fellows; they struggle manfully with their 
little sections and answer admirably the purpose of making 
some of the students inhale the weekly outside readings; but 
they do not get under the skin of the imdergraduate. I re- 
member more of the courses under Professor Taussig and Pro- 
fessor Garver in which these full grown men directed the class 
discussions than I remember of any two other courses which 
consisted entirely of lectures or of two lectiu'es plus one section 
meeting under a fledgling. . . . Suppose one or more of the full 
professors were each to take one of the sections each week. 
Every section would thus get a thick slice of the professional 
cake several times a year. The professor, by devoting the en- 
tire hour to spirited discussion, would leave a lasting impression 
on the minds of the students. 

No, 219, A.B. (magna cum laude) LL.B. Class of 1908. 
Economics i, 2, and 6b. Lawyer. 

Of the courses I took the one that to my mind could and 
should be improved was Economics i, with regard to the work 
in the sections. Whether thb was the fault of the assistants 
who had charge of the sections, or whether it was inherent in a 
course in a subject which is new to most of the men taking it, 
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I do not know, but at least until the first hour-exams, the scope 
and idea of the entire subject was rather hazy to most of the 
men I knew. Personally, I did not find that the section work 
supplemented the lectnres and outside reading as it should 
have. 

No. 200. S.B. (ciim laude) Class of 1911. Economics i, 
5, 18, and 28- With • . • Railroad. 

The assistant in this case was a graduate of a smaller college 
who was working for a Ph.D. He was totally out of sympathy 
with his students, and he was positively a detriment. This 
is the main fault with the assistants — they don't care, take no 
pride in their duties, and work merely because it is a mild way 
of paying for their tuition. ... I condemn the system of using 
imsuitable assistants in the courses. 

No. 165. A.B. (cum laude) Class of 191 2. Economics i, 
4b, 6a, 6b, iib, 12, and 16. Law Student. 

One point which in my opinion cannot be overemphasized, is 
the need of having assistants in the larger coiurses who are in- 
terested in the subject and in their students, and who are able 
to guide the discussion in section meetings so that it becomes 
more than a mechanical test of the retentiveness of the student's 
memory and the amount of time he has put on his work. If the 
student is led to anticipate a lively discussion in section meet- 
ing, his preparatory work immediately takes on a different 
aspect. He looks for intellectual problems that he knows he 
will have to grapple with and casts about in his own mind for 
argimients which he can use in the dass room. The deadening 
eflfect of an assistant who merely tries to find out if youVe done 
the prescribed reading is enough to spoil one's interest in any 
course on Economics. 

No. 6. A.B. (cum laude) Class of 191 2. Economics i, 4a, 
4b, and 6a. Newspaper (Editorial Department). 

The men who serve as assistants are for the most part im- 
practical men. In writing a thesis on a present-day subject, a 
man needs some guidance from men who have a more practical 
tum of mind. Theoretical analyses are not always suflicient. 
I met yoimg instructors who were so engrossed in their graduate 
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work or in the theoretical principles of Economics that they 
apparently f ound little time to read the newspapers or current 
magazines. 

No. 22Q. LL.B. Class of 1912. Economics i, 2b, 3, 4, and 
18. Lawyer. 

The manner in which the instnictors (not the professors) 
graded theses as task jobs and with no attempt to recognize or 
preserve original research leads one to give them what they 
seem to want — i. e., a hackneyed piece of work of so many 
pages that is easy to read (a t)^ewritten thesis being sure of a 
passing grade). In one case, I deliberately copied a Uiesis from 
a book of a former Harvard Professor in the same course and 
received an A on it. Needless to say that ended my interest 
in thesis courses. 

No. 2y6. A.B. (summa cum laude) Class of 1907. Eco- 
nomics I, 14a, and 14b. Editor. 

The review section with its discussion of the lectures and 
readings of the week was stimulating, possibly because the 
section-man was considerably above the average of the as- 
sistants. 

Practical Applications 

The following paragraphs elaborate the data given above 
under the head of Suggestions and CriticismSy part (a). 

Sixty-three men criticize in various ways the practical 
applications made in the Economics courses. Thirty-five 
of these state that in nearly all courses more emphasis ought 
to be placed upon practical problems of the present day. 
They seem to think that for the great majority of students 
the matter dealt with was too theoretical, philosophical, or 
historical, and had too little concrete application to problems 
with which the classes could be expected to be familiar. 
Discussions of a theoretical character appear to have left 
little or no impression unless they were applied to actual 
conditions through theses, discussions, or investigations 
on the part of the student. In this connection it may be 
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interesting to note that ten replies were received containing 
statements to the eflfect that the writers had forgotten all 
of the material leamed in Economics and that so far as they 
coxild see they had derived no benefit from the study. Two 
of these admit that they did not study as they shoxild have 
done and received passing grades by cramming for examina- 
tions. (These ten are not included in the 63 tabxilated 
above.) 

Seven suggest that visits be made to banks, stock éx- 
changes, factories, and various business houses in order to 
give the students the needed contact with the business 
world. Several suggest that speakers from the outside be 
brought in to lecture on the fieids in which they have proved 
successful. Three believe that there shoxild be illustrations 
of the actual transactions of banking, stocks and bonds, etc, 
for the sake of students who have had a limited experience 
or a deficient secondary school preparation. Debates on 
contemporary issues are frequently spoken of as a good 
means of arousing interest and stimulating further study. 

Among the topics which are mentioned as being neglected 
are: labor problems from the employer's point of view 
(6 replies); socialism (5); foreign exchange (i); scientific 
management and business organization (i); single tax (i). 
Four men want the department to do more toward teaching 
correct ideals of citizenship and 3 think that more should 
be done toward combating the propaganda of the radical 
press. 

Two want the principles expounded by Mill more thor- 
oughly apphed to modem times and i thinks that the time 
spent in reading Spencer was entirely wasted. Two think 
that students get a false conception of the significance of 
present-day problems due to the predominance of theoretical 
and historical discussions. 

Two think that it would be helpful to present a brief 
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summary or survey of the principal factors in our own 
economic system in order that the student may have some 
concrete f oxmdation upon which to base his later theoretical 
study. Three suggest that students be earlier familiarized 
with the current literature on economic questions both in the 
technical and in the popxilar periodicals. Two are of the 
opinion that much valuable aid coxild be rendered graduates 
by the publication of annotated bibliographies of ciirrent 
economic literature. Lack of guidance from matiire, 
practical men in selecting courses and in writing theses 
was felt to be a serious fault by two persons. 

Quotations 

No. 38. A.B. Class of 1906. Economics i, 2, and two 
other courses. Mining Engineer. 

Wherever possible, an application of economic prindples to 
present-day conditions will do more to emphasize the import- 
ance of the theory and to impress the same on the mind than 
any amoimt of "extra reading" or thesis work. A free discus- 
sion of economic theory from all angles is the best possible in- 
centive to study. I got more out of conferences, I think, than 
out of all the rest of the work. The instructor allowed a certain 
amount of informality and toward the end debate was pretty 
strong. One excellent feature is to encoiu'age independent ideas 
and bring them up for discussion. 

No. 56. A.B. A.M. (Bis.) Class of 1891. Economics i 
and 2. Lawyer. 

I think the aim should be, without diminution of training in 
sound economic thinking, to develop real economists who are 
in touch with modem conditions, particularly in the United 
States. As one who took Economics as a mere side issue, and 
as a dtizen who is profoundly interested in the problems of to- 
day, I feel the country's sore need of broad-minded, well- 
grounded, well-informed, up-to-date economists. I am sorry 
to say that I think there are few in the country. Those who 
profess to be economists are too nearly exdusively concemed 
in the far-away and the highly theoretical. Whether the col- 
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lege can do anything to remedy this, I don't know. I think it 
ought to try and try hard. 

No. 125. A.B, (cum laude) A.M. Class of 1903. Eco- 
nomics i. Teacher, 

I should suggest . . . that the conf erence questions be applied 
to matters concrete enough to reach the life-mterests of the 
student. On one of my pages I find the question, "Can a con- 
vertible paper currency become permanently redundant?" I 
cannot help having a good deal of curiosity as to what I did 
with that question on my paper. 

No. 14Q. LL.B. Class of 1903. Economics i (repeated). 
Lawyer. 

I took the course twice. . . . It was more or less unintelli- 
gible both times but at the second try I got through. I think 
the trouble was that I had no practical knowledge of banking 
or commerce and didn't know any of the methods or funda- 
mental facts. It seems to me that a certain amount of practical 
instruction at the beginning . . . would be very useful. You 
can't expect a man to comprehend the first prindples of Eco- 
nomics when he does not know the difference between a promis- 
sory note and a draft. I do not think that I am abnormally 
stupid, but I do not think that Economics i, as taught, was of 
any value to me at all. 

No. 166. A.B. (University of Kansas) A.M. Economics 
I, 2, 4, 5, 6, 7, 8, and 20. Farmer and lecturer on 
Economics. 

My general criticism is that most of the courses were not as 
practical as they should be; depended too much on theories or 
principles which when I have tried to apply them frequently 
did not fit. . . . College teaching is not close enough to busi- 
ness life and activity. ... I have leamed more helpful eco- 
nomics from my farming experiences and from talking with 
business men than I did at Harvard. 

No. I g 3. A.B. (cimi laude) Class of 1909. Economics i, 2, 
6a, and 6b. Editor, Lecturer. 

Having come to college at a more mature age than most of 
my class-mates and af ter some years' experience in metropolitan 
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joumalism, I was constantly irritated during my conrses in 
history, economics, and govemment by the failure of teachers 
to relate class room material to current events. Students were 
not made to feel the vitality of the subjects under discussion. 
Present-day applications, references to new developments in a 
certain field, comments which showed that the teacher had 
read his morning newspaper were rare indeed and, in the case 
of some teachers, altogether absent. Student interest was in- 
variably stirred by such references. . . . (Economics 2). The 
conclusion to which I have come is that economic theory has 
absolutely no bearing on the facts of life except over "long-time 
periods." And since 99 per cent of himian concem is with 
**short-time periods," economic theory confounds rather than 
clarifies. I wasted a lot of time and thought trying to recon- 
cile professorial conclusions with reality. I should strongly 
advocate a more honest admission that economic theory is 
largely a survival of the brightest in an intellectual prize fight 
over a definition of terms. 

No. 227. A.B. (cum laude) Class of 1909. Economics i, 2, 
6a, 6b, and 18. Meat Packer. 

In general (speaking only of courses for my time at college), 
I should suggest that the Department of Economics deem itself 
responsible for presenting to the young men, a large majority 
of whom are going to enter business, as faithful as possible a 
picture of modem business organization, its untold scientific 
possibilities, and the high ideals that can pervade it. They 
cannot in this work do without the assistance of the high-grade 
business man, who is the man who knows the problems, and 
who would be glad to address the students. 

No. 228. A.B. (ciun laude) Class of 1891. Economics 
1,2, and 6. Lawyer. 

If a piece of legislation like the Riu'al Credits Bill had been 
given me for investigation and report, I should have been in- 
finitely more benefitted than by digging into the economic as- 
pects of the South Sea Bubble. When it is so easy for the prac- 
tical to assist the theoretical, it should constantly do so. There 
is no reason for Economics to be a ''dismal science" if it is co- 
ordinated with contemporary affairs. A student of forestry 
seeks the forests; not all studies have forests to observe, but the 
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whole world every moment offers conditions and events for 
the information and observation of the student of politicai 
economy. 

No. 286. A.B. (magna cum laude) Class of 1907. Eco- 
nomics i, 18, and two others. Accountant. 

Like most other college students, I was more interested in 
applied economics than in economic theory. The prindples 
developed in the lectures should be more thoroughly applied to 
actual practical cases in the sections or in thesis work. This 
should be done at every stage of the course; otherwise the prin- 
dples leamed seem of little practical importance and are soon 
forgotten. 

No. 298. A.B. Class of 1906. Economics i and several 
other courses. Boston Merchant. 

In vocational training the courses given at Harvard are pain- 
fully weak in my opinion, and largely so because they are so far 
removed from the public contact that real business training 
needs. They seem more to train the mind to meet situations 
that may arise in the business world than to offer actual con- 
tact with these situations. . . . If the college could induce 
200 business houses to take one student for a month, and let 
him stay a week or more in each department, they would be 
adding a value to the Economic and Business courses that they 
do not now possess. 



B. From Students 

I. The nuntber of replies to this questionnaire was 546 — 
a large proportion of the total number distributed, certainly 
much over half , although the exact percentage cannot be 
given because a considerable number of students received 
the blanks in several courses. There were 1007 registra- 
tions in Economics courses in March, 1915, which means, 
possibly, 850 individuals, not over 800 of whom could 
have received the questionnaires. The total is large enough 
to provide a good survey of opinion among students of 
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Economics in the College. The whole number was divided 
as follows: 

Students taking Economics A only 308 

Undergraduates taking courses more advanced 

than Economics A 208 

Graduate students 30 

2. The degrees for which these students were candidates 
were: 

(a) Students taking Economics A only: 

Candidates for A.B 257 

" " " S.B 41 

" " " AJV I 

Not candidates for a degree 4 

Notlisted 5 

308 

(b) Undergraduates taking advanced courses: 

Candidates for A.B 185 

" " " S.B 23 

208 

(c) Graduate Students: 

Candidates for A.M 12 

" " " Ph.D II 

Not a candidate for a degree .... i 

Notlisted 6 

Of the total number (546), about 80 per cent were 
undergraduates in regular standing. 

3. The dasses in which these students were registered 
were: 

(a) Economics A: 

Seniors (1915) 20 

Juniors (1916) 82 

Sophomores (1917) 173 

Freshmen (1918) 6 

Unclassified 26 

Spedal I 

308 
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(b) Advanced ooones: 

Seniors 80 

Juniors zoz 

Sophomores 23 

Undassified 4 

208 

(c) Graduate students: 

First Year 20 

Second 6 

Third 2 

Fourth I 

Not stated z 

4. Intention to pursue Economics fiirther is shown by the 
foUowingfigures: 



Undernaduate« Undergraduates 

taking Economks taking Advanced Graduate 

Aonly Couises Students Totals 



Yes 132 86 7 225 

No 107 68 6 181 

Undedded . . 51 10 5 66 

No answer . . 18 48 12 78 

5. Concentration in Economics was indicated as foUows: 

Students taking Studoits taking 

Economics A only Advanced Couxses Totals 

Economics 40 95 135 

Economics and Government .... 14 17 31 

Economics and History 6 8 14 

Economics, Government, and History 5 11 16 

Economics, Philosophy, and Sodal 

Ethics — I I 

Economics and Philosophy .... — i i 

Totals 65 133 198 

6. Candidates for degrees with distinction in Economics 
appeared as f ollows : 

Students takins Students taking 

Economics A oel^ Advanced Couxses Totals 

Economics 61 24 85 

Economics and Government .... z 2 3 

Economics and History o z z 

Economics, Government, and History 3 5 8 

Economics and Philosophy .... z 3 4 

66 35 zoz 
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7. The occupations into which these students expected to 
go were: 





Students takinc 
Economks A omy 


Students taking 


Graduate 






Advanced Couises 


Students 


Totals 


I. Business . . 


68 


92 


— 


160 




57 


43 


I 


lOI 


3. Teaching . . 


24 


6 


20 


50 


4. Engineering 


16 


2 


— 


18 


5. Medidne . . 


16 


2 


I 


19 


6. Banking . . . 


13 


13 


I 


26 


7. Chemistry . . 


II 


S 


— 


16 


8. Journalism 


8 


4 


I 


13 


9. Ministry. . . 


5 


— 


4 


9 


10. Agriculture . 


3 


5 


I 


9 


II. Theatre . . . 


3 


— 


— 


3 


12. Effidency En 


m 








gineering . 


2 


I 


— 


3 


13. Mining . . . 


2 


I 


— 


3 


14. Ardiitecture . 


2 


— 


— 


2 


15. Public Servia 


1 2 


— 


— 


2 


16. Consular Ser 


- 








vice . . . 


2 


2 


I 


S 


17. Advertising . 


I 


— 


— 




18. Politics . . . 


I 


— 


— 




19. Geological 










Survey . . 


I 


— 


— 




20. Biologicai Re 


m 








search . . 


I 


— 


— 




21. Electridty . . 


I 


— 


— 




22. U. S. Anny . 


I 


I 


— 




23. Accountancy . 





I 


— 




24. Government 










Admin. . . 


^— 


I 


_ 





Ninety-six men were undedded: 11 Seniors, 31 Juniors, 
50 Sophomores, i Freshman, 3 Unclassified. Sixty-eight 
of these men were taking Economics A only. 

The occupations chosen were divided for certain puiposes 
of comparison into two groups — first, the group for which 
Economics is commonly supposed to be preparatory — 
Business and the Law; second, the group for which Eco- 
nomics is not commonly supposed to be preparation — 
Engineering, Medicine, Agriculture, etc. The purpose of 
this division was to see whether students intending to enter 
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the Law or Business expect more direct help from Economics 
courses than do the others. Teaching, Joumalismi the 
Ministry, Public Service, Consular Service and Politics, 
all occupations in which knowledge of Economics might be 
highly useful, were omitted from the coimt of the second 
group, in order that the contrast, if any appeared, might 
be sharply drawn between the clearly vocational outlook 
and the clearly non- vocational outlook of the students in 
the two groups. When an answer was equivocal it was 
put with one group or the other only when all the possibili- 
ties suggested fell within that group. 
The groups compared thus as to nutnbers: 

Vocational Non-Vocational Neatnd Not 

Group Group Group Grooped 

Students taking Economics A only . 150 57 43 59 

Students taking Advanced courses . 155 18 12 23 

Graduate Students 2 2 26 o 

307 77 80 82 

According to this grouping, concentrations in Economics 
and in Economics and other Sub jects divide as f ollows : 

NON-VOCATXONAL 

VocAnoNAL Group Group 

III lli I IP « 
•S 



il ¥^ ^ Il P' 



CO CO CO c/} 

Economics 32 74 106 033 

Economics and Government 9 16 25 000 

Economics and Histoiy . . 4 7 11 o i z 
Economics, Government and 

Histoiy I 9 10 o o o 

Economics and Philosophy .0 i i 000 

Concentrations in Economics and in Economics and other 
subjects f all overwhelmingly in the vocational group. As will 
be seen from the table imder the f ollowing heading, this group 
expects of the instruction help in vocations more frequently 
than does the other, but direct help only about as much. 
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8. The hdp expected by the students in their several 
vocations may be seen from the foUowing figures: 

II lin ^3 ^ 1 1 I §5^ s 

*il m II I II H I -i^it I 



Ir I|5 Jl ^ P '?5 « pli 



•o 

CO c/} «24 

Directly helpful . . 48 45 z6 109 67 7 35 — 109 

Indirectly helpf ul . 158 n8 9 285 216 50 19 — 285 

Not helpful .... 39 12 o 51 19 16 16 — 51 
No answer or too 
equivocal for 

record .... 63 33 5 loi $ 4 10 82 loi 

Totals .... 308 208 30 546 307 77 80 82 546 

Of the whole number of students 73 per cent expect help; 20 per cent direct 
help; 53 per cent indirect. Of the vocational group 92 per cent expect help; 
22 per cent direct; 70 per cent indirect. 

9. The chief reasons given for taking Economics courses 

* 

were: 

^o*! ^11 I-i I 

ii^ s-is 25 2 

Ui CO 

1. Expected courses to be directly helpful in 

vocation 25 37 8 70 

2. Expected indirect help through a know- 

ledge of prindples, etc 57 33 2 92 

3. In order to understand elementary eco- 

nomic prindples 30 10 o 40 

4. As part of a general education, for informa- 

tion or broader vision 51 21 i 73 

5. For mental training or methods of reason- 

ing 13 18 3 34 

6. For a better understanding of aflfairs of 

theday 17 21 2 40 

7. For dtizenship, better understanding of 

politics or legislation 11 7 i 19 

8. For a better understanding of flodal 

problems 30 13 6 49 

9. For a better understanding of finandal, 

industrial, and legislative problems . . 29 19 2 50 

10. For purely cultural values 10 2 2 14 

11. Because of natural interest in EooDomics . 12 38 16 66 

12. To fiU out college schedulet 32 9 o 41 



ISO 
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10. The specific reasons for taking paxticular courses 
could not be distinguished from the general reasons for 
studying Economics. Apparently the students did not 
diflFerentiate clearly between their general puiposes in 
studying the subject and the ways in which special courses 
might serve those purposes. 

11. The advice or information because of which courses 
were chosen appears from the f ollowing figures : 



Faculty Advisor 
Member of the 

Faculty . . 
Senior Advisor 
Tutor . . . 
Relatives . . 
Catalogue . . 
Reputation of the 

Course .... 



Students taking 
Economics A oiuy 

23 



8 

I 
I 
8 

9 
39 



Students taking 
Advanced Courses 

21 



19 

I 

o 

14 

33 



Graduate 
Students 


Totals 





44 


16 


43 





2 





z 





22 


4 


46 



41 



84 



Total number of statements conceming sources of advice or information 242 



12. The most hdpftd courses in other Departments (with 
respect to the study of Economics) were listed thus: 





Students taking 
Economics A omy 


Students taking 


Ckraduate 






Advanced Courses 


Students 


Totals 


Government 31 . 


2 


3 


— 


5 


English .... 


S 


— 


— 


S 


Physics 


3 


2 


— 


5 


Geology . . . . 


2 


3 




5 


History30 . . . 


I 


5 


— 


6 


" 32b . . 


S 




I 


6 


" 32 . . . 




7 


— 


7 


Government 17 . 


I 


6 


— 


7 


Chemistry . . 


S 


2 




7 


Modem Language 


s I 


7 


— 


8 


Psychology . . . 


S 


S 


I 


II 


Government 9 . . 


S 


7 


— 


12 


English A . . . . 


II 


3 


— 


14 


History 10 . . . 


7 


9 


— 


16 


History 13 . . . 


8 


14 


— 


22 


Mathematics . . 


16 


14 


— 


30 


Government. . , 


19 


10 


2 


31 
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Studento takinc 
Economics A only 


Students taking 
Advanced Couraes 


Graduate 
Students 


Totals 


Philosophy . . 
Social Ethics . 


13 
4 




z6 
23 


3 
8 


32 
35 


History 


19 




33 


3 ' 


44 


" I 

X • • • 

Government i . . 


27 
48 




23 
36 


3 


52 
74 



13. The reasansfor this hdpftdness were listed thus: 



1. Answers too general for classification . . 

2. Courses said by student to give training in 

reasoning 

3. Practicalapplicationof economicprindples 

4. Gave power of expression 

5. Gave power of interpretation 

6. Historical illustrations and applications of 

economic prindples 

7. "Supplementary values'' 

8. Subject matter — useful as introduction to 

and preparation for Economics .... 

9. Subject matter parallel or identical . . . 

10. Methods useful as introduction to and 

preparation for Economics 

(a) Practice in plotting graphs and diagrams 
{b) Other useful methods not spedfied . . 

11. Methods parallel or identical 

12. Help obtained from reading 

13. Gave a different point of view 

14. Gave valuable moral or ethical setting . . 

15. Gave general information 

14. The diffictdties met in the study of Economics are 
shown by the foUowing summary: 

I. Nature of the course or of the instruction: 

(a) Treatment too theoretical 79 

(6) Lack of deamess in lecture and discussion .... $6 

(c) Lectures not helpful 45 

(d) Valueless discussion 24 

(e) Course hurried, too much groimd covered, more time 

for discussion needed 30 

(/) Disregard of other authorities 13 



Students taking 

Economics A 

only 

Students taking 

Advanced 

Counes 


Graduate 
StudenU 


1 


26 


25 


3 


54 


20 


8 


X 


29 


10 


14 


— 


24 


14 


8 


— 


33 


4 


3 


— 


6 


36 


39 


3 


77 


4 


I 


I 


6 


3 


3 


— 


6 


12 


IS 


3 


30 


7 


6 


z 


14 


13 


I 


I 


14 





3 


— 


3 


I 


S 


— 


6 


I 


3 


3 


5 


— 


3 


I 


4 


I 


— 


— 


I 
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2. Lack of facilities: 

(a) Lack of hooks for assigned reading 52 

(b) Need of a better textbook 40 

(c) Crowded sections 11 

3. Disadvantageous reqxiirements: 

(a) Too large or faulty assignment of reading 45 

(b) Toomuch thesis work. 13 

4. Lack of supervision or effident leadership: 

(a) Need of doser touch with instructors 43 

(6) Need of better section men 42 

5. Miscellaneous: 

(a) Personal incapadty, lack of interest 69 

(6) Unsatisfactory or imfair methods of rating sdiolar- 

ship 35 

(c) Misimderstanding of nature of course 13 

; 15. The relative hdpfidness of various phases of the 
work in Economics is siimmarized below. It was possible 
to treat the answers to this question statistically in a 
more elaborate fashion than could be used with the 
other retums. 

Analysis and Interpretation of Returns to Question 13 
of Questionnaire for Undergraduates 

The question asked was as f oUows : 

Mark in order (i, 2, etc.) the following phases of the work ac- 
cording to their rdative hdpfuhiess to you, beginning with the most 
hdpful: lectures; dass discussions; assigned reading; reports; labora- 
tory; comments or additional information. 

Practically all the students supplied data on this point. 
The distribution of the relative values (in point of helpful- 
ness) assigned by the entire group is that indicated in 
Tables 1-3. 
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TABLE I 

NuMBER OF Students Taking Coxjrses m Econoiocs Assigning 
DiFEESENT Positions to Vabious Phases of the Work 

ACCOKDING TO THE DeGREE OF *' HeLFFULNESS 



>» 



Phase of the Work x 

Lectures 97 

Classroom Discussions 180 



Assigned Reading . 

Reports 

Essays and Theses . 
Laboratoiy Exerdses 
Comments, etc. . . 
Totals .... 



253 

13 

15 
8 

3 
569 



2 
148 

180 

20 

14 

14 

7 

SAO 



3 

214 

99 
69 

56 

38 
26 

20 

522 



4 
4« 

SS 
22 

78 
39 
32 
42 
310 



S 

IS 
16 

14 
39 
33 
33 
24 
174 



6 

4 

13 

3 
20 

30 
22 

16 

108 



7 

3 

4 

o 

2 

20 

10 

IS 
S4 



4 
6 

I 

z 

4 

2 

o 
18 



Totals 

S27 
S30 

S42 
229 

193 
147 
127 

2295 



TABLE 2 

Per Cents of Students Assigning Different Positions to 

Each Phase of the Work 



Phase of the Work 
Lectures ...... 

Classroom Discussions 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratoiy Exerdses 
Comments, etc. . . 



X 

18 

34 

47 
6 

8 

S 

2 



2 
28 

39 

33 

9 

7 

10 

6 



3 

41 
19 
13 
24 
20 
18 
16 



4 

8 
10 

4 

34 
20 

22 
33 



S 

3 

3 

3 

17 

17 
22 

19 



6 

I 

3 
I 

9 
16 

IS 
13 



7 

I 
I 
O 
I 
10 

7 
12 



o 
I 
I 
o 

I 

2 
I 
O 



TABLE 3 

Per Cents of Different Positions Assigned to Different 

Phases of the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



I 

17 
32 

4S 

2 

3 

IS 
o 



2 

27 
29 
33 

4 
3 

3 

I 



3 

41 

19 

13 
II 

7 
S 

4 



4 

14 
18 

7 

2S 

13 
10 

I 



s 

9 

9 
8 

22 

19 
19 
14 



6 

4 

12 

3 

19 
28 

20 
IS 



7 
6 

7 
o 

4 

37 

19 
28 



o 
22 

33 
6 

6 
22 
II 

o 



From these figures a number of things are apparent: 
I. That in the opinion of the undergraduates various phases 
of the work in Exonomics rank in order: (i) Assigned reading; 
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(2) Classroom discussions; (3) Lectures, etc. II. Apparently 
the other phases of the work are rdatively less he^ful to 
the students as a whole. III. While these retums can 
represent only the opinions of the students, it is neverthdess 
true that the success of any of the phases of the work is 
conditioned by the attitude which the students assume 
toward it, and therefore the attitude of the students as 
indicated by these retums is important. IV. The retums 
are of course affected by the usual factor of individual 
dififerences and the faet that a fairly large proportion of 
the students can be found assigning first place to any of the 
three important phases indicates the supplementary nature 
of those three phases in class work. 

Since it is possible that somewhat advanced students in 
Economics may well find a phase of the work particularly 
helpful which may be less helpful to the yoimger students 
who have not taken work in Economics previously, a 
comparison of the distributions in Economics A alone and 
in other courses in Economics may indicate some important 
differences. The distribution of assignments of value for 
Economics A alone is presented in Tables 4, 5, 6, and for 
students in all other classes in Economics in Tables 7, 8, and 
9. Perhaps the only important diflFerence is to be foimd in 
the faet that the order of helpfulness for students in Eco- 
nomics A alone is first, assigned reading, second, classroom 
discussions, and third, lectures; whereas for students taking 
advanced courses the order of the relative importance is 
first, assigned reading, second, lectures, and third, classroom 
discussion. In other words, for advanced students ap- 
parently the lectures are of much greater value than is the 
case with the students beginning the study of Economics. 
This is shown very definitely in the percentile distribution 
of tables. 
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TABLE 4 

NuMBES OF Students Taking Econoiocs A Assignino DmESENT 
Positions to Vabious Phases of the Work AæosDiNG 

TO THE DeGSEE OF ''HeLFFULMESS'' 

Phase o( the Work las 45670 Totab 

Lectures 24 63 172 30 6 2 2 4 303 

Classroom Discussions .... 134 125 44 12 o 3 o 3 321 

Assigned Reading 164 112 29 3 7 i o z 317 

Reports 2 2 19 26 11 11 i o 72 

Essays and Theses i 3 7 7 8 13 10 2 51 

Laboratory Ezerdses 3 5 zi 10 13 4 3 2 51 

Comments, etc 3 6 15 33 10 4 4 o 75 

Totals 331 316 297 121 55 38 20 12 1190 



TABLE S 

Per Cents of Students Assigning Different Positions to 

Each Phase of the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



8 
41 
S« 

3 

2 

6 

4 



21 

39 

35 

3 
6 

10 

8 



s 

57 
14 

9 
26 

19 
22 

20 



4 
10 

3 

I 

36 

14 
20 

44 



S 

2 
O 

2 

15 
18 

26 
13 



I 
I 
O 

15 
26 

8 

S 



7 

I 
O 
O 

I 
20 

6 

5 



I 
I 
o 
o 

4 
4 
o 



TABLE 6 

Per Cents of Different Positions Assigned to 
Different Phases of the Work 



Phase of the Work 

Lectures 

Classroom Discussions 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



7 
40 

50 
I 
o 

X 
X 



20 

40 

35 

I 

I 
2 
2 



s 

58 

15 

10 

6 

2 

4 
5 



25 
10 

3 
22 

6 

8 

28 



s 

II 
o 

13 

20 

15 
24 
18 



5 
8 

3 
29 

34 

II 
10 



7 

10 

o 
o 

5 
50 

15 
20 



33 

25 
8 

o 
17 

17 

o 
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TABLE 7 

NuMBER aw Stddents Taking Advanced Couxses m Ecohqmics 

AssiGNiNG DirrEREMT PosmoNs TO Vasious P&ases or 

THE Work AcrøRDOiG to the Degree of ''Heipfulness" 

PbMC of the Work i i $ 4 5670 Totab 

Lectures 73 85 4^ 12 9 2 z o 224 

Clawroom Discussions .... 46 32 55 43 16 10 4 3 209 

Aflsigned Reading 89 68 40 19 7 2 00 225 

Reports 11 18 37 52 28 9 z x X57 

Essays and Theses 14 11 31 32 25 17 10 2 Z42 

Laboratory Ezerdses 5 9 15 22 20 18 7 o 96 

Comments, etc o i 5 9 14 Z2 iz o 52 

Totals 238 224 225 Z89 119 70 34 6 ZZ05 



TABLE 8 

Per Cents of Students Assigning Different Positions to 

Each Phase of the Work 



Phue of the Work 

Lectures 

Classroom Disoission 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc . . 



33 
22 

40 

7 
10 

5 
o 



38 
IS 

30 

12 

8 

9 

2 



19 
26 

18 

24 
22 

16 

10 



5 
21 

8 

33 
23 
23 

17 



4 
8 

3 

18 

18 
21 

27 



I 

5 

I 

6 
12 

19 
23 



7 

O 
2 
O 
Z 

7 

7 
21 



o 
2 
o 
I 
I 
o 
o 



TABLE 9 

Per Cent of Different Positions Assigned to 
Different Phases of the Work 



Phue of the Work 

Lectures 

Classroom Discussion 
Assigned Reading . 

Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



31 

19 

37 

5 
6 

2 

o 



38 

14 

30 

3 

5 

4 



19 
24 
18 
16 

14 

7 

2 



4 

6 
22 
10 
28 

17 
12 

5 



s 

8 

14 
6 

24 
21 

17 
12 



3 
14 

3 
13 
24 
26 

17 



7 

3 
za 

o 

3 

»9 
az 

3« 



o 

SO 
o 

17 

33 
o 

o 
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A flirther question of interest is whether the better stu- 
dents assign a diflferent order of values to the various phases 
of the work. Hence, in Tables lo, ii, and 12 is presented 
the distribution of assignments of value for advanced 
students in Economics whose previous work in Economics 
had averaged better than C. It is clear that the order of 
values for the better group of students is apparently lectures 
and assigned reading bidding for first place, with classroom 
discussion a bad third, essays and theses showing a possible 
gain over the distribution in the general group. 

TABLE 10 

NuMBEs OF Students Taking Advanced Coukses in Economics Assignino 
DiFTESENT Positions to Various Phases of the Work According to 
THE Degree of "Heipfulness" — Better Students Only 

Phase of the Work tis 4 5670 Totals 

Lectures 31 31 12 8 3 o 00 85 

Classroom Discussion ... 14 8 25 17 9 6 22 83 

Assigned Reading .... 3^ 31 15 8 3 o 00 89 

Reports 6 9 12 17 11 2 00 57 

Essays and Theses .... 9 5 16 13 8 5 10 57 

Laboratory Exerdses ... 1477995042 

CommentSy etc o o x 3 4 6 20 16 

Totals 93 88 88 73 47 28 10 2 429 

TABLE II 

Per Cents of Students Assignino Different Positions to 

Each Phase of the Work 

Phase of the Work xs S4S670 

Lectures 37 37 14 9 4 o o o 

Classroom Discussion .. 17 10 30 21 11 7 3 3 

Assigned Reading ... 36 35 17 9 3 o 00 

Reports 11 16 21 30 19 3 o o 

Essays and Theses ... 16 9 28 23 14 9 20 

Laboratory Exerdses . . 2 10 17 17 21 21 12 o 

Comments, etc o o 6 19 25 27 13 o 
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TABLE 12 

Per Cents of Diffekent Positions Assigned to Diffesent 

Phases of THE Work 



Phase of the Work 1934 567 

Lectures 

Classroom Discussion 
Assigned Reading . 



Reports 

Essays and Theses . 
Laboratory Exerdses 
Comments, etc. . . 



33 35 14 " 6 o o o 

15 9 28 33 19 31 20 zoo 



34 35 17 IX 6 o o o 

7 10 14 23 23 7 o o 

10 6 18 18 17 18 zo o 

I 5 8 10 19 32 50 o 

o o z 4 9 21 20 o 



Since the relative values of the various phases of the 
work of the course diflfer not only for individual students, 
but also for individual instructors, an analysis of the dis- 
tribution of values assigned by students in Economics A 
is of particular interest. Here the important phases of the 
work are apparently lectures, class discussions, and reading. 
Since the lectures are the same for all, and the assigned 
readings are the same for all, interest centers particularly in 
the question of the relative value assigned to class discussion. 
Taking the group as a whole and considering only these three 
phases of the work we find that classroom discussion is 
assigned first, second, and third piaces in the proportion 
indicated in the table following. By using this as a rough 
standard for the entire group we may compare with that 
standard the relative value assigned to class discussion (the 
sole variable factor) as it appears in the retums by students 
separated according to the instructor concemed. These 
distributions are indicated in Table 13. 
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TABLE 13 

Distribution of Ciass Discussion Assignhemts of Value (in Point 

OF Helpfulness) by Students of Economics A (1914-1915) 

AæosDiNG to THE Instructor Involved 





Numberof 


Per Cent of Students Asaigning 


Positions 


Instnictor 


Caaes 


z 


a 


3 


AU 


322 


42 


39 


18 


Y 


31 


39 


48 


13 


X 


61 


49 


43 


8 


W 


54 


57 


37 


6 


V 


24 


25 


50 


25 


u 


44 


41 


41 


18 


T 


SO 


28 


40 


32 


S 


22 


18 


64 


18 



From this table it would appear that it is quite possible 
that instructors W and X are highly effident in the conduct 
of classroom discussion, that instructors U and Y have a 
fair degree of success, and instructors S, T, and V are rela- 
tively unsuccessful in the classroom discussion. However, 
since relatively small nimibers are involved, the table should 
be suggestive for self-examination rather than for dogmatic 
assertions conceming the relative efficiency of the classroom 
discussion as conducted by the various instructors. 

16. The problems met in life, to which instruction in 
Economics was considered related, were stated in such 
general terms that the answers in this colunm have very little 
value, except to confirm the testimony on lack of practical 
applications. They are siunmarized below. Although the 
students are interested in very specific problems, in their 
statements conceming which they of ten show the influence 
of instruction they are receiving in courses in Economics, 
they interpreted the question conceming the relation be- 
tween instmction in Economics and problems of lif e in an 
entirely general fashion. 

1 . General affirmative answers 89 

2. Negative answers 122 
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3. Spedfic help in vocation 6 

4. Indirect help in vocation ao 

5. Understanding of fundamental economic principles 3 

6. Better general education and information 5 

7. Training in reaaoning 9 

8. Gave broader outlook 14 

9. Gave politicai insight and information 33 

10 Better imderstanding of social problems 39 

11. Better understanding of economic problems otherthan social 56 

12. Better understanding and power to judge current affairs 4^ 

13. Better understanding of economic terms i 

14. Avoid current fallades 4 

15. Understanding banking and investment problems 16 

16. Helpful in accounting 3 

17. Helpful in accoimting 2 

18. Cultural values '. x 

19. Purchasing of commodities 3 

20. Help in arranging Sunday School dass work x 



17. The mavements or problems of the day in which the 
students professed themselves interested were: 






Labor problems, unemployment, 
tråde imionism, capital and la- 
bor, etc 61 

Sodalism 53 

Tari£f, protection, free tråde ... 32 

Peace, disarmament 24 

Woman suffrage, feminism ... 22 
Problems of banking, finance, and 

currency 18 

Prohibition 17 

Immigration, race problems ... 17 

Rural and agricultural problems 17 

South American tråde 16 

The war, and its social and eco- 
nomic effects 15 

Problems of business organization, 

development, and regulation . . 14 

Educational problems 14 

Single tax 14 

Problems of govemment and 

politics 14 

Munidpal administration, dty 

planning 13 

Tazation 13 



Sodal reform in general X2 

Public ownership and regulation X2 

Preparedness xx 

Public health, sanitation, housing xo 
International tråde, law, and rela- 
tions 8 

Trust legislation 7 

Railroad problems 7 

Religions problems 6 

Conservation 6 

Distribution of wealth 5 

Industrial development and effi- 

dency $ 

Eugenics, sex problems 5 

Co5perative enteiprises 5 

Land values and land titles ... 5 

Penology and prisons 5 

The negro problem 4 

Child labor 2 

Pure food 2 

Charities sndphilanthropy. ... 2 

Juvenile courts 2 

None 7 

Many, all, in general 29 
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i8. Suggestions and criticisms may be summarized as 
follows: 

lit m II 

Ih 



SI 



3 


^^ 


4 


4 


— 


9 


3 


— 


14 


2 


— 


8 


— 


— 


3 


— 


X 


3 


2 


— 


6 


4 


— 


6 


4 


— 


7 


4 


— 


6 



SecHons and Assistants ^ ^ 

I. Poor personality and poor tearhing ability 31x5 
3. Hold aloof. Do not appredate students' 

point of view 3 17 x 21 

3. Hair-splitting distinctions and tedmical 

phraseology i i x 3 

4. Impossible to get clear outlines or well- 

defined ideas x 

5. Fewer sections and more lectures .... 5 

6. Fewer lectures and more sections .... 11 

7. Sections too large 6 

8. Double A section undesirable 3 

9. No instruction on "how to study". ... 2 

10. Too much emphasis on the text 4 

11. Time not properly allotted 2 

12. Discussion ill directed. No limit on talk- 

ative members 3 

13. Written questions not discussed in dass . 2 

14. Reasons for failure not explained .... i — — x 

Lectures 

15. Too theoretical 13 24 3 40 

16. Better lectures desirable 5 x x 7 

17. Lectures follow book too dosely .... 24 2 — 26 

18. Object to textbook 3 — — 3 

19. Wish views of other economists 6 4 2 X2 

20. Suggest speakers outside department . . 4 i — 5 

21. Lectures not correlated with reading (See 

also 42 below) x x — 2 

23. Lectures and discussions do not darify 

reading 3 x — 4 

33. Too much superfluous matter 4 2 — 6 

34. More time on first chapters of book ... 3 — — 3 

35. More careful choice of topics 2 2 2 6 

36. Too many qualifying expressions .... 2 x — 3 

37. Treat protection and free tråde together .2 — — 2 

38. Hard to hear the lecture 6 — — 6 

Examinaiions and Tests 

39. More just and uniform marking system .6 4 3 '3 
30. General review to preæde ezamination .4 x — 5 
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^11 ^11 II 

Exandnaiions and Tests So w 

31. Too much emphasis on technical terms .3 i — 4 

32. Questions on historical rather than eco- 

nomic view 2 — — 2 

33. Too little time on tests 5 2 i 8 

34. Too much weight on mid-years and finals 12x4 

35. More nmnerous papers, tests, and reports 5 6 — xz 

36. Tests too easy i — — i 

37. Questions asked for too much detail, lay 

too much stress on memory and offer 

no choice 3 — — 3 

Theses 

(See also 54, 55, 56 below) 

38. Requirements burdensome i 

39. More theses should be required 3 

Reading 

40. Assign more outside reading 5 

41. Reading requirements burdensome ... 2 

42. Reading poorly correlated with lectures . 7 

43. Allow more general and require less spedfic 

reading 3 

44. Critidsm of individuals x 

General Suggestions 

45. More printed questions 5 

46. Catalogue gives wrong impression .... 3 

47. Abolish oral examinations 2 

48. More contact, advice and help from pro- 

fessors 5 

49. More discussions and debates 14 

50. Open Economics A to freshmen 2 

51. Discuss current periodicals in dass ... — 

52. No material for thesis assigned — 

53. Theses should be more carefully supervised — 

54. Thesis subject too remote from the general 

topic — 2 — 

55. Economics Department suggest groups of 

studies in Economics for certain pro- 
fessions — — 

56. Standardized prindj^es ezpounded in z 

sections — 3 i 
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Favorable comments are frequent, as the following 
excerpts show. Favorable comments on individual instruc- 
tors are often enthusiastic. 

Sttidents taking Economics A only, 

Economics A . Twenty-six men speak f avorably of this course 
and those who give it. The foUowmg are some of the comments: 
"Well run"; "admirably conducted"; "very good indeed"; 
"mechanically perfect"; "course is inteUigently and efficiently 
håndled"; "best run of all the large courses"; "the most effi- 
ciently conducted of any of the courses I have taken"; "tech- 
nically above reproach." One man is so pleased with the course 
that he declares "it should be made compulsory." 

Students taking Advanced Courses and Graduate Students. 

Twenty men speak very favorably of the courses they have 
taken. 

Economics A. "Well conducted"; "the most nearly perfect 
course in college — the theories can be grasped and bluffing doesn't 
count"; "I have nothing but praise for Economics A; the class 
discussions are particularly stimulating"; "sensibly conducted"; 
"of great value"; "the honor section is fine." 

Other courses. "Economics 3 is well conducted"; "Economics 9 
is extremely stimulating"; "Economics 5 and Economics 6 are 
well conducted"; "Economics 11 is one of the best courses I ever 
took"; "Economics 11 is the best course on account of the train- 
ing in reasoning." 

Comment on the Department in General. "Well satisfied with 
the Economics Department"; "courses are conducted in a very 
efficient, sensible way"; "the Economics Department seems the 
best conducted of any department.^ 



>i 



These suggestions and criticisms are often put with a 
force to which the summary given above cannot qnite do 
justice. The foUowing smimiary taken directly from the 
replies is therefore added. 
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Section Meetings and Assistants 

More criticisms are made by students on this subject than 
on any other single point. Much stronger feeling is evi- 
denced by advanced and graduate students than by those 
taking Economics A only. Twenty-nine men from the first 
group and ten from the second (39 in all) make specific and 
severe accusations against the personality and teaching 
ability of assistants. They state that these instructors 
appear to have been chosen for high marks in Economics 
courses and not for their fitness as teachers, that they hold 
themselves too much aloof from the students and do not 
try to appreciate the student point of view, that they are 
unfair in their judgments and f ail to be helpful m presenting 
the work or in stimulating discussion, and that they tend 
toward hairsplitting distinctions and technical phraseology. 
Graduate students are particularly opposed to the type of 
assistant often chosen. 

Fourteen replies mention various ways in which the section 
meetings are not systematicaUy conducted. They refer to 
the lack of specific planning of the work and say that it is 
impossible to get clear outlines or weU defijied ideas from 
the instruction given. 

Ten advanced and graduate students think that dis- 
cussions are frequently too "fine spun," are not properly 
directed, do not hold the attention of the class, are vague, 
technical, and do not clarify the questions raised. 

The suggestion is made by four men that some means 
should be taken to standardize the principles expoimded in 
the sections. They cite instances where the instructors 
have dijffered with professors on important issues and have 
thus confused the classes by injecting their own opinions. 

Five men believe that there should be f ewer sections and 
more lectures, but there are on the other hånd thirteen rq)lies 
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which consider the lectures of Economics A a waste of time 
and demand more section meetings. 

Eight men object to the size of the sections and think 
that better discussions could be had in smaller groups. 

Two men mention the AA section as especially imdesirable 
and think that it should be abolished. 

The following criticisms of methods in section meetings 
seem to be worth considering. 

1 . There are no lectures on how to study and little instruc- 
tion in methods of coUecting material, using library facili- 
ties, etc. 

2. The sections emphasize the text to the exclusion of 
other important matters. 

3. Too much authority is given to assistants in assigning 
reading, resulting in irregular assignments. 

4. Where laboratory sections are required, the amount 
of outside reading is not decreased and the requirements are 
burdensome. 

5. There is not always time to finish the problems assigned 
during the laboratory period. 

6. The laboratory assistants are careless in checking up 
the work of the students. 

7. Proper time allotment in the sections is often seriously 
neglected. 

8. Discussions are not well directed, do not include enough 
students, and no limit is placed on talkative members. 

9. The subject is not developed in new forms and interest 
is not aroused. 

10. Too many puzzling questions are asked and textbook 
answers are expected. 

1 1 . Written questions are not discussed in class. 

12. No definite explanations are given of the reasonsfor 
failure so that the student can avoid future blunders of a 
similar sort. 
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13. There is no iiniform standard of requirements. The 
suggestion is made that the professors take sections in tum, 
thus giving the students a share of their time. 



Lectures 

The practical application of the courses is a matter which 
probably touches all the teaching in the Department, but 
seems especially important in connection with lectures, 
since the attitude taken by the professors in their lectures 
largely determines the trend of discussions and the character 
of written work. Thirty students in Economics A and 
thirty-three advanced and gradu^-te students (sixty-three 
in all) believe that the courses are too theoretical, lack in 
concrete illustrations, and are not suflSciently applied to 
current, social, politicai, and financial problems. 

Twenty-six men in Economics A object to having the 
lectures follow the textbook so closely. A considerable 
number of these object to the book itself. Sixteen men 
would like to have the views of other economists presented 
in Economics A. Many wish that speakers from other 
departments or from the business world might be heard. 

The following seem to be the most important suggestions 
conceming the conduct of lectures. 

1 . Correlation between reading and lectures is not always 
apparent. Lectures and discussions do not clarify or 
properly criticize the required reading. 13 replies. 

2. There is too much superfluous matter in Economics A 
and the course is confusing because of the large amount of 
material and the detail accompanying it. 6 replies. 

3. More time ought to be spent on the first chapters of 
the book. The work of the first few weeks is theoretical 
and leaves a confused impression. 3 replies. 

4. More careful choice should be made of the parts to be 
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treated in the lectiires. Only the more diflScult portions 
need to be discussed. 2 replies. 

5. There are too many qualifjdng and limiting expressions. 
Students are confused by them. 3 replies. 

6. No outline or summary is provided. Statistical 
matter is not put on the blackboards or distributed on 
mimeographed sheets. 6 replies. 

7. Protection should be taken up simultaneously with 
f ree tråde so that the two may be contrasted and compared. 
Let students choose for themselves on such questions. 

8. The lecture cannot always be heard distinctly. 3 
replies. 

9. Lectures cannot be heard in the rear of the gallery. 

3 replies. 

Examinations and W ritten Tests 

1 . A more imif orm and just system of marking is needed. 
10 replies. 

2. A general review preceding examinations would be 
helpful. 

3. The method of grading graduate students leads to 
cramming and decreased real productive work and clear 
thinking. 

4. Assistants expect students to use a certain phraseology 
in their answers which induces mimicry and discounts 
independent expression. Too much emphasis is placed upon 
technical terms used nowhere save in Economics courses. 

4 replies. 

5. Questions are asked from the historical rather than the 
economic viewpoint. 2 replies. 

6. Too little time is given for the short tests. They are 
an unfair basis for judging ability. Foreigners especially 
find great difficulty in gettmg anythmg written on questions 
proposed. 6 replies. 
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7. Too much stress is laid upon mid-year and final 
examinations. 4 replies. 

8. There ought to be more numerous papers, tests, and 
weekly reports. 8 replies from Economics A. 

9. Questions ask for minute detail, lay too much stress on 

memory, and there is no choice of questions. 5 replies, 

Economics A. 

Theses 

1. Thesis work is overdone and the requirements are 
burdensome. 19 replies. 

2. Thesis was assigned on which no material was available. 
3 replies. 

3. More help and advice ought to be given on the first 
thesis. All theses should be more carefully supervised. 
Professors are disappointing in the interest shown in gradu- 
ate students. 4 replies. 

4. Theses and reading requirements overlap. 

5. The assigned subject was too remote from the general 
topic. 

6. Theses in the different courses ought to be coordinated. 

Reading 

1 . Assignments are irregular so that students cannot plan 
their work well. 

2. More outside reading should be assigned in Economics 
A. 7 replies. 

3. The requirements are burdensome in some courses. 

4. Reading is not well correlated with lectures and dis- 
cussions. 12 replies. 

5. Allow more general and require less specific reading. 

General Suggestions 

I. The printed questions are very helpful. There ought 
to be more of them. 3 replies. 
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2. The catalogue gives the wrong impression in regard 
to Economics conrses. Students are led to believe that they 
are practical courses. 

3. Ventilation is poor in some rooms. Massachusetts 
Hall is a very unpleasant place in which to work. 

4. Current periodicals should be read and discussed in 
class. 

5. Oral examinations ought to be abolished. 2 replies. 

6. More advice and help from the professors is needed. 
More personal contact ought to be secured through con- 
ferences. 16 replies. 

7. There ought to be more emphasis upon discussions and 
debates. 29 replies. 

8. Open Economics A to Freshmen and give a course 
especiaUy suited to them so that men can decide earlier 
where they wish to concentrate. 

III. General Discussion 

The outstanding faet about both these sets of replies is 
their variety. The accomplishment of the alumni, taken as 
a body, and the seriousness and directness both of the alumni 
and of the students, as also the definiteness of their views, 
would give one respect for a concensus of their opinions; 
but it is hard to find any real concensus of opinion in their 
answers. One must be content to note tendencies, and to 
take individual suggestions for what they may be worth. 
This is probably the common experience with replies from 
questionnaires. 

About half (58 per cent) of the graduates are in Business 
or the Law ; about half (54 per cent) of the students intend 
to go in to Business or the Law. Of the graduate group in 
Law and Business 35 per cent foimd their instruction in 
Economics actually helpful; of the imdergraduate group 
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intending to enter these occupations 22 per cent expect to 
find their instruction in Economics directly helpful. Educa- 
tors, journalists, ministers, and farmers find the courses 
vocationally valuable quite as of ten as do business men and 
lawyers; and the graduates as a whole find their work in 
Economics quite as valuable for "general culture" as they 
do in their vocations. The proportion who note specific 
social and cultural values is surprisingly small. On the 
whole, the expectations of the students are not imwarranted 
by the experience of their elders. The count on values 
shows, however, how diflScult it is to differentiate one value 
from another — or how unused men are to the attempt. 
Perhaps it shows also the lack of definite objectives in the 
instruction and of full information on the part of students 
conceming their teachers' aims. It is a striking faet that 
the replies conceming specific reasons for choosing par- 
ticular courses could not be distinguished from those con- 
ceming the choice of Economics as a field of college work. 
This faet is not imrelated, moreover, to the faet that these 
students foimd it impossible to make clear the connection 
between their courses and specific problems met in life. 

The evidence as to the values of instruction in Econom- 
ics thus shows no very exact conception of the bearing of 
the subject on the activities of men. Twenty per cent of 
the alimmi make definite confession of their inability to 
discover tangible results from their study of Economics or 
to give concrete examples of its value. The preponder- 
ance of testimony to the efifect that Economics had proved 
of value in "other, more general phases of life," rather than 
in vocations or in "social, civic, or economic activities out- 
side vocation" — (vocational values foimd by 42 per cent 
of alumm, social-dvic values by 26 per cent, general values 
by 64 per cent) — implies the same vagueness. This em- 
phasis on "general" values nms through all the vocational 
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groups: of the lawyers, for example, 54 per cent make no 
comment on vocational values, and 67 per cent make no 
comment on social-civic values; whereas 70 per cent find 
general values. Fourteen per cent of the lawyers confess 
confusion of mind as to values. A similar showing appears 
from the testimony of the manuf acturers : 44 per cent make 
no comment on vocational values, 83 per cent make no 
comment on social-civic values; whereas 67 per cent find 
general values. The tendency to credit the study of Eco- 
nomics with a " disciplinary " effect on the mind may well 
be another evidence of inability to discover specific appli- 
cations. Sixteen per cent of the lawyers mention general 
discipline and many of the alumni, of all groups, use phrases 
implying belief in it. Although one who sees quite clearly 
the connection of instruction in Economics with definite 
objectives in the careers and interests of men may neverthe- 
less see also a general effect of such instruction in widening 
mental perspective and fixing habits and ideals of intellec- 
tual thoroughness, still the unqualified ascription of "disci- 
pline" to instruction in any subject is not imlikely to mean 
that the student is unable or unwilling to discover just what 
use he has made of the facts, the principles, the ideals, the 
points of view, or the methods he acquired from his study. 
At any rate, there can be no reasonable question of the faet 
that the alimmi are uncertain as to the direct applications 
of what they secured from their courses in Economics, 
whether they accoimt it knowledge, insight, power, or what- 
ever else. 

Surely these facts afford a safe basis for effort to define 
more clearly the aims of college instruction in Economics. 
A sharper differentiation of objective between course and 
course can but render each course the more effective for its 
special purpose. This is as true of general courses as of 
others — and it is to be noted that there is some demand 
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for general courses even at the expense of the more special- 
ized courses. If both teacher and pupil understand that a 
given course aims solely at general intelligence conceming 
economic facts and forces and that the course involves 
neither practical training nor the full discussion of special 
economic problems, there can be no disappointment or con- 
f usion if the course does not result in the devdopment of ' 
special abilities or settled opinions on particular issues. 
But ought there not to be certain courses which do secure 
these results? Or, as it is more important still to ask, if 
courses are already given which seem clearly to f avor prac- 
tical and definite results, ought not these courses to be 
more openly set apart from the "cultural" and "distribu- 
tive" courses and combined into concentration Schedules 
for specific piuposes? The alimmi testimony conceming 
courses the writers "wish they had taken" is eloquent on 
this point. They wish they had taken courses of a practical 
character and evidently regret that they were not advised 
to do so. Since their time, to be sure, the Department has 
made much progress in this matter. There is a group of 
courses annoimced under the caption "Applied Econom- 
ics," and the departmental Schedules for concentration and 
the degree with distinction now distinguishes specialization 
in Applied Economics from specialization in Economic 
Theory or Economic History. But there is not enough 
emphasis on the aims to be achieved in such courses or such 
Schedules. The academic distinctions between graduate 
and imdergraduate courses confuse the issue, and the de- 
scriptions of the courses do not suflSciently inform the 
student of the results he may expect. The present (191 7) 
offering of the Department is rich in special courses, but 
almost entirely lacking in any open statement as to their 
usefulness, either singly or in combination, for any possible 
piuposes of the student. 
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All this is but to say that the replies to the questionnaires 
support the contentions of Chapter II, above, on Aims. In 
much of our college instruction we are ignoring the purposes 
and needs of the students in order to carry out theories 
which have never been openly discussed. We ar^ insist- 
ing on academic distinctions involving issues never brought 
to the surface. The theory of formal discipline interplays 
in our work with the theory of general culture and the theory 
of special training, but we have no clearly defined scheme 
for achieving different values by definite means and in 
definite combinations of courses. 

The replies to the questionnaires give very strong support 
to the conclusion that the instruction in Economics fails to 
bring the student into close enough contact with economic 
data outside of books. Probably this criticism applies more 
to the past than to the present, and it may be voiced less 
often by the "brilliant" student (who most readily fills 
words with content) than by his less theoretically-minded 
fellows. But among students as among alumni, the most 
frequent criticism is that courses are "too theoretical" or 
*4ack practical application." The root of the objection to 
yoimg section men lies quite as much in the faet that they 
do not "know the world" as it does in the faet that they 
are interested primarily in their graduate studies. The 
whole trend of the suggestions and critidsms is in f avor of a 
closer connection between study and "life." The change 
desired is a change of emphasis, a change in the choice of 
illustrative materials and problems, and a change in modes 
of presentation. It is as desirable in general courses as in 
others and might be brought about without adopting any 
settled policy as to practical training. 

The retums conceming advice on the selection of courses 
help to confirm the conclusion that the purposes of students 
are too often ignored. Only a little over half of the students 
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replied on this point, and of these one-third took conrses on 
their reputation, one-sixth on information from the cata- 
logue. Only a third of these students chose courses on ad- 
vice or information from members of the Faculty. 

Taken as a whole these retums from the questionnaires 
are convincing as to the need for an adjustment of college 
instruction to the aims and desires of our college popula- 
tion. We suJØfer still from the tradition that a college edu- 
cation is a preparation solely for a lif e of cultured leisure or 
else exclusively for the leamed professions. It would be 
imfortimate indeed if we were to break with the past too 
abruptly or give up the aims and methods which have stood 
the test of time. But if we are to maintain the American 
college as an institution wherein fully half the students are 
to become business men, scientific workers, govemment 
officials, farmers, and the like, our views of college instruction 
cannot remain as simple and imcritical as they still are. We 
need not ignore the general purpose to help every college 
student to be an intelligent himian being and a good dtizen; 
indeed we must emphasize that purpose : but we can no longer 
def end imduly academic teaching nor pressure toward " schol- 
arship" as such, on the groimd that it is "good" for every 
student. We cannot treat students abstractly as "individ- 
uals." What they intend to do in life must have some 
weight with us when we advise them and when we frame the 
courses and Schedules they are to pursue. We must build 
up a more complete and organic aim for college teaching, 
based on fuller knowledge of our pupils and the uses of our 
instruction. 

In spite of the faet that there is a wide scattering of 
opinion in the replies to these questionnaires, a careful study 
of the retums shows how heavily they are weighted with the 
desire for instruction which shaU challenge the student to 
greater interest, efiFort, and response. It is the artificiality 
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and remoteness of college work with which there is most dis- 
content. Because students want the subject to be hrought 
home to them, they call for closer contact with professors, 
for more experienced assistants, for lectures by business men, 
for more f requent reference to current events, and for most 
of the rest of the great variety of things they consider desira- 
ble. Through all the Usts and tables of this chapter, there 
runs a note of appeal for the closer adaptation of college work 
to the needs and purposes of the individual student. 



CHAPTER VI 

METHOD 

I. The Place of Method in College Teaching 

There are no universal criteria of correct method in teach- 
ing, for teaching has no single character which can be so 
analyzed as to yield a fixed "form" or a set of technical 
rules applicable to every lesson or exercise. Principles of 
teaching are like principles of conduct or of style: they 
are statements conceming the nature of means and ends and 
of the adaptation of one to the other in the whole course of 
the teacher's work, Teaching, to be sure, must be judged 
at every point by its efiFects on the student; no method can 
be defended merely because it suits a purpose of the teacher 
other than the purpose to promote the process of leaming 
in his pupils : but the process of leaming, liberally considered, 
has so many parts and aspects and is so variously conditioned 
by the difiFering aims of the difiFerent subjects, by the differing 
circumstances of difiFerent schools, classes, and periods, and 
by the difiFering capacities of mdividuals and groups, that 
the method of a given exercise can be judged only in its 
relation to the total activity of which it forms a part. It is 
one contact among many between the mind of the instructor 
and the minds of his pupils. If it is well conceived and 
properly carried out, it forwards m some appreciable degree 
and in some particular way the student's progress m the 
subject. Only in the light, therefore, of an intimate and 
comprehensive knowledge of the complete plan of a course 

— the whole complex interchange between instructor and 
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students — can the method of a class hour be justly 
viewed- 

For these reasons this chapter must be impersonal and 
without specific application. It can only set forth in general 
terms the problems of method in college teaching as this 
Inspection has presented them anew and from a difiFerent 
angle to the members of the Division of Education. It 
must accordingly risk the charge of being purely theoretical: 
but it is not in faet the expression of a theory ; rather it is an 
objective description and discussion of the factors in a 
general problem as they have been strikingly impressed on 
our minds by our visits to classes in the various Economics 
courses, by the examination of class papers, outlines, and 
reading lists, by the comments of graduates occasionaUy 
consulted, by the careful analysis of examinations, by 
systematic reports on the study-habits of certain imder- 
graduates, and by the retums to the questionnaires. We 
found it impossible to investigate single courses so fully as 
to feel justified in ofiFering personal reactions on the methods 
of individual instructors; and we should have hesitated 
in any case to do so because of our lack of systematic 
knowledge of the subjects taught. In spite of the cordial 
invitation of the Department and of individual instructors 
to visit fully and to make our suggestions direct and personal, 
we can in consequence present only impersonal impressions 
and general conclusions. 

It must be admitted that a treatment of this sort will 
have practical value only according to the extent and serious- 
ness of the critical attention it causes to be focused on the 
factors of instruction most in need of it. What these factors 
are, in all its courses or in any, the Department of Economics 
can itself best determine. The Department can also best 
determine how to secure for these factors a new or an added 
emphasis. As we now see the problem, the submission for 
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departmental consideration of complete plans for courses, 
and visits by departmental committees, with frank dis- 
cussion of the resnlting impressions, suggest themselves as 
the best means for inducing wholesome experimentation in 
method; but it gæs without saying that such action can be 
useful only when it is imforced, welcome to the instructor 
by reason of a genuine interest in its ends, and productive of 
no hasty eflfort to adopt methods or devices not fully incor- 
porated in the whole scheme of the instructor's teaching. 
Permanent improvement in method must be based, we 
believe, on careful experiment with selected factors in 
teaching, seen in their relation to other factors; and this 
view we have tried to embody in the f ollowing discussion of 
our data in this field. 

To secure these data we visited 25 classes, including 
20 lectures or general class-meetings, and 5 section-meetings. 
Reports of these visits were filed at once, and later con- 
sidered as a group and in connection with the data from the 
questionnaires and the other sources. The visits were made, 
for the most part, during the academic year 1914-15, 
especially in November and December, 19 14, and January, 
1915; also in the early weeks of May, 1914. They brought 
us into contact with the work of nearly aU the imdergraduate 
courses then in operation, specifically, Economics A, i», 2», 
3j 5> 6% 8, 14, and 31. The visitor in each case had in hånd 
the statement of aims submitted by the instructor in the 
course. 

A grouping of the points mentioned in the comments on 
the visits and in certain retums from the questionnaires and 
from the other studies provides the headings listed below, 
each of which covers a part or aspect of the problem of 
college teaching, simply as teaching, although such headings 
also suggest, of course, problems of aim, of the organization 
of curricula, of administration, and of marking. The head- 
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ings are neither exhaustive nor mutually exclusive. The 
list is made up strictly from the data of this Inspection. 
Although the replies to the questiomiaires are by agreement 
to be retained in confidence by the Division of Education, 
and the comments on the visits were also confidential, the 
summaries of the questionnaires, given m Chapter V may 
readily be compared with the list. Probably the list includes 
about all the chief factors in eflfective college instruction, 
and it includes many which are clearly recognized and 
admirably used in some or all of the coiu-ses we visited; 
but it doubtless misses altogether many factors of critical 
importance in particular courses. In no single exercise, 
perhaps in no single course, can all the factors listed be fully 
utilized. If the list and the discussion present adequately 
the various factors, each in its relation to the others, both 
those here considered and those that will occur to the 
readers of the report, this chapter will meet such expectations 
of its value as we could reasonably entertain. 

Note. A statement of our general impressions from the visits 
may be of interest, despite the faet that it can have only the value of 
a rough concensus of personal judgments. The reports show that the 
instruction in Economics, viewed as a whole, and so far as it went, 
impressed us as excellent. The lectures, with few exceptions, we foimd 
clear, well-organized, stimulating, and forceful. Although in one or 
two instances they seemed to lack vitality and to win only a per- 
functory attention from the students, in several cases they were as 
admirable for the power to arouse and hold the interest of the class, 
as for other good qualities. The sections we visited were noticeably 
less efifective, in general, than the regular class meetings. In no case 
did the visitor consider the section work wholly unsuccessful, but in 
some of the sections the youth and the personal qualities of the as- 
sistants made the meetings far less profitable than they should have 
been. 

It may also be worth while to mention here what seem to us to be 
the most promising directions for effort in the improvement of the 
undergraduate instruction given by the Department. These are: 
first, the abandonment, so far as may be possible, of sections, and in 



l8o THE TEACHING OF ECONOMICS 

courses where sections must be maintained, such measures as may be 
needed to secure assistants of greater maturity, fuller scholarship, 
and better training for their work; second, the adoption of methods 
for establishing doser contact between teachers and students (of 
which the Tutorial scheme now in operation is one) and espedally for 
securing more frequent and more profitable reactions from the stu- 
dents, including fuller participation in class meetings; third, greater 
effort to devise and conduct with advantage, exerdses which will 
bring the students into active contact with the problems of the sub- 
ject, in their practical form. These proposals are discussed somewhat 
more fully bdow. 



II. A List of Factors m College Teaching, 

ESPECIALLY m THE TeACHING OF EcONOMICS 

A. Factors which aflfect the attitude of the student toward his 
work. 

(a) The stimulation of purpose in general and the definition 
of spedfic aims, by 

(i) Encouraging an imderstanding of the scope, object, 
and values of the course, by means of 

(a) Advice in the selection of the course 
(6) Printed statements about the course 

(c) Personal conference with students early in the 
course 

(d) Early discussion in dass of the character of 
the work required and of its values 

(2) Adapting the work, at least in part, to individual 
interests and needs, by means of 

(a) Permission to choose, within limits and imder 
guidance, the subjects of theses, spedal read- 
ing, and other independent work 

(b) Personal conferences with students 

(c) Discussion and criticism of tests and examina- 
tion books, in addition to the return of 
marks. 

(d) Personal guidance in thesis work, espedally in 
the case of students unaccustomed to it 

(é) Provision for supplementary and voluntary 
reading or other work beyond the reqiiirements 
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(3) Rdating the conrse to present problems of conduct 
or of thought, by means of 

(a) Discussion of these problems in class meetings, 
and frankness on the part of the instructor 
conceming his own point of view 

(6) Recognition of these problems in the choice of 
reading, thesis subjects, and other work 

(c) Lectures by persons other than the instructor 

{d) Credit in the course for participation in in- 
vestigations and other projects imder govem- 
mental, philanthropic, or business auspices 

{e) Opportxmity to use data from observation and 
investigation of activities, as in business and 
govemment, as well as from books 

(/) The use of current literature as material for 
class discussions, reports, etc. 

(b) The maintenance of attention and interest during class 
meetings, by 

(i) Securing appropriate attention in advance to the 
topics to be considered during class meetings, by 
means of 

(a) Assignments of spedal reading to be done in 
advance, and such tests or records of it as may 
be necessary 

(6) Formulation of spedfic problems and questions 
to be considered in connection with the read- 
ing, or independently, and the requirement, at 
discretion, of written or oral reactions on them 

(c) Encoiu-agement, or assignment as a task, of the 
discovery by students of particular problems 
imder a general prindple, or of new facts and 
applications involved; annoimcement in ad- 
vance of a date for discussion of these 

(2) Connecting class meetings definitely and explidtly 
with the other work of the course, by means of 

(a) Outlines and syllabi of . the main divisions of the 
course, showing the connection of the lectures 
and class discussions with the general assigned 
reading and other independent work 

(6) Reports in dass from individuak or groups on 
reading or investigation on the topic in band 
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(c) Use of required texts and other material in 
class as the basis of discussions or lectures 

(J) Carefnl correlation of the lectures and the sec- 
tion meetings 

(e) Discussion in class of written papers and other 
assigned work 

(3) Making clear the purpose of each class meeting 
and assuring a measure of progress toward it during 
the hour, by means of 

(a) Statements of purpose by the instructor and 
statements by students on question from the 
instructor 

(6) Outlines on the board or on sheets distributed 
to the class 

(c) Prevention of irrelevant discussion, question, 
and comment, and dismissal or postponement 
of problems not profitable to discuss — occa- 
sionally with assignments for reading or study 
to be done either by the class or by individuaLs 
or groups 

(d) Summaries of discussion, by the instructor or 
by the students 

(4) Providing appropriate opportxmity during dass 
hours for participation by the students, and mak- 
ing their participation profitable, by means of 

(a) Discussion, kept relevant and stimulated by 
comment and question from the instructor 

(6) "Socratic" development of the topic by ques- 
tion and answer 

(c) Quizzes, oral or written; brief papers in 
class 

(J) Encouragement of questions from the class 

(e) Records on the board of diverse opinions or 
points of view presented by students, and 
discussion or lecturing on the issue thus 
formulated 

(/) Extension of the discussion to the whole mem- 
bership of the class; direction of discussion .to 
the class, not to the instructor 

(g) Encouragement for the presentation in das 
of instances, examples, applications, and prob 
lems discovered or formulated by the students 
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(5) Using skillfully and advisedly the opportunities of 
the instructor's position for personal influence, by 
means of 

(a) Good lecturing, and skillful leadership in dis- 
oission 

(6) Frank expression of personal opinion and point 
of view on issues of importance in or connected 
with the subject of the course 

{c) Full and fair statement of contrary theories 
and points of view, in advance of criticism or 
comment 

{d) Cordial recognition of divergent opinion on 
the part of students 

{é) The use of concrete and familiar instances, ex- 
amples, and cases; the encouragement of stu- 
dents in discovery and citation of these 

(O Unsparing attention to the personal difficulties 
of individuals, outside of class meetings 

(g) Lectures by persons other than the instructor 

(c) The encouragement and direction of effort in study and 
in other work outside of class, by 

(i) Setting up reasonable standards of performance 
and maintaining them equitably, by means of 

(a) Careful calculation of the time required for 
reading, theses, and other work 

(6) Full statement of the requirements as to form 
in written work 

(c) Coordination of thesis requirements with 
those of other courses, and consultation with 
students and other instructors as to the 
best times for the submission of written 
work 

((/) Adequate directions for the use of sources, 
bibliographies, etc; care in arranging for prac- 
tical exercises; attention to library facilities, 
laboratory arrangements, opportunities for 
fieldwork, etc. 

{é) Insistence on promptness in subnutting work 

(J) Personal conf erence with students in the course 
of their work 

{g) Frequent use of tests, quizzes, brief papers, 
etc, with explidt statements, of the way in 
which these are to ''count" in the final mark 
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(k) Spedfic references to reading, avoiding waste 
of time or neglect of work because of diffi- 
culty in discovering the application of assigned 
reading to the problem in hånd 

(2) Giving personal and adequate attention to the com- 
pleted work submitted by students, by means of 

(a) Full reading and personal conmient in the case 
of theses and other written productions 

(b) Personal conf erences on the results of investiga^ 
tions and other practical exerdses 

(c) Care in grading 

B. Factors which favor eflFectiveness of eflfort in the work itself. 

(a) The general organization of the course to prevent waste 
of time and distraction of effort, by 

(i) Coordinating the various requirements of the course, 
by metos of 

(a) Definite statements of the piuposes in view, 
both for the course as a whole, and for sepa- 
rate assignments and* exerdses 

(b) Outlines of topics for dass meetings, showing 
the connection between assigned reading and 
the lectures and discussions. (See A, (b), 
(2), (a), above) 

(c) Careful correlation of the lectures and the sec- 
tion meetings. (See A, (b), (2), (J), above) 

(2) Defining exactly the work to be done (see A, (c), 
(i), above), by means of 

(a) Printed statements in an outline or syllabus of 
the course 

(&) Adequate directions for the use of sources, 
bibUographies, etc; care in arranging for prac- 
tical exerdses; attention to library facilities, 
laboratory arrangements, (^portunities for 
fiddwork, etc (See A, (c), (i), (</)» above) 

(c) The use of forms for return of inf (Mrmation of a 
fixed character 

(3) Keeping dosdy in touch with the work of indi- 
vidxial students, by means of 

(a) Rqx>rts on reading and other work 

(b) Personal conf erences 
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(4) Managing tests, quizzes, brief papers, and examina- 
tions so as to show students their progress and help 
them to understand the subject, by means of 
(a) Care in choosing questions and topics 
(6) Discussion of the results in class and in con- 
ferences 

(b) The management of class and section meetings to favor 
effective leaming of various types, by 

(i) Assuring adequate and appropriate impressions 
when a set of figures, a graph, or other visual 
material is to be memorized, by means of 

(a) Distribution of printed sheets 

(6) Use of the blackboard 

(c) Use of colors, either on the board or on sheets 

{d) Use of the reflectoscope 

{e) Use of photographs 

(/) Insistance on accurate copying into notebooks 

of the material presented 
{g) Full explanation of the significance of the 

material 

(2) Assuring full assimilation of a definition, heading, 
quotation, or other exact statement to be memo- 
rized, either verbatim or in substance, by means of 

(a) Distribution of printed sheets 

(6) Use of the blackboard 

(c) Insistance on accurate cop}dng in notebooks 

((/) Full exposition of the meaning 

{e) Discussion of cases, exceptions, opposites, etc. 

(/) Questions to test the students' grasp of the 
statement or their ability to apply it 

(3) Assuring complete imderstanding of a generaliza- 
tion, theory, point of view, interpretation, or other 
complex object of thought, by means of 

(a) Full exposition of the facts involved, prefer- 
ably before the generalization itself is presented 
— preceded or accompanied, if possible, by 
actual observation of facts and situations, in 
addition to or in place of presentation by lec- 
tures or reading 

(6) Careful definition of the problem which the 
facts present, preferably by discussion — based 
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if possible, on participation in work which in- 
volves the problem in practical form 

(c) Encouragement of attempts on the part of 
students to make the generaUzation for them- 
selves; discussion of students' generalizations, 
either in class or in conferences 

(d) Discussion of cases, exceptions, applications, 
etc; quizzes, exercises, practical assignments 

(4) Providing opportimities, incentives, and guidance 
for constructive thinking in class, by means of 

(a) Full statement of the facts to be considered — 
sometimes by the students, sometimes by the 
instructor; use of the blackboard to bring out 
clearly the facts or their significance 

(b) Definition of issues by discussion 

(c) Reports of reading or fieldwork, or statements 
of point of view by individuals and groups 

(d) Presentation of facts or convictions by "out- 
siders" 

(e) Discussion in class of theses, or of passages 
from texts 

(/) Discussion in dass of required oral or written 
statements or argiunents on imsettled problems 

(g) Careful avoidance of dogmatism on the part 
of the instructor, without hesitation in ex- 
pressing his own point of view 

(Å) The discussion of principles in their actual ap- 
plication to cases and situations, either real or 
hypothetical 

(5) Using the lecture, discussion, quizz, recitation, 
and other modes of teaching with due regard to 
conditions, e. g., nimiber in the class, their knowl- 
edge of the subject, etc, and to the character of 
the material to be considered, its difficulty, 
familiarity, the exactness with which it is to be 
recalled, etc. 

(6) Making the physical conditions of the classroom as 
favorable as possible for attention 

(c) The direction of work outside of class to favor eflfective 
effort, by 

(i) Encouraging good management in reading, thesis- 
work, etc, by means of 
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(a) Early and complete statement of requirements. 
(See A, (c), (i), (a) and (6), above) 

(6) Discussion of the character of the assignments 
and directions as to study and work. (See A, (c) 
(i), ((/), above) 

(c) Personal conferences 

{(i) Reports on reading, brief papers, outlines, 
quizzes, and other tests and reactions; discus- 
sion of these in class and in conferences 

{e) Advice on review for examinations; the inspec- 
tion of notebooks; discussion of habits of study 
and the organization of materials 

(2) Using all opportunities to bring students into actual 
contact with the facts and problems of the subject, 
by means of 

(a) Requirement of personal observation to sup- 
plement reading. (See A, (a), (3), (c), above) 

(6) Participation in the work of govemmental, 
philanthropic, and other agendes and institu- 
tions. (See A, (a), (3), (d), above) 

(c) Investigations and other "projects" of an 
active sort 

((/) Reports by students of instances, exceptions^ 
and applications in contemporary life ^^ 

(3) Encouraging constructive work and direct personal 
f ormulation of problems, by means of 

(a) Permission to choose, within limits and imder 
guidance, the subjects of theses, special read- 
ing, and other independent work. (See A, (a), 
(2), (a), above) 

(6) Personal conferences 

{c) Reports by individuals and groups in class. 
(See A, (b), (2), (6), above) 

((/) Encoiu*agement of supplementary and volim- 
tary reading and other independent work 

(4) Avoiding assignments for work outside of class 
which involve leaming most eflfectively accom- 
plished imder direction, by means of 

(a) Occasional use of class time for presentation of 
material for exact memorization. (See B, (b), 
(i), above) 
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(b) Occasional use of dass time for memorization 
of verbal statements. (See B, (b), (2), above) 

(5) Avoiding in class the presentation of material more 
economically studied outside of class, by means of 

(a) Use of printed sheets, docmnents procurable 
by students, etc. 

(b) Assignment as a task of written analysis or 
application of prindples or problems not 
adapted to class discussion or not suffidently 
important or difficnlt to warrant it 

III. General Discussion 

Such a list as this requires no explanation, for it presents 
no suggestion difficult to understand, however difficult 
some may be to carry out; but it may well raise issues on 
which there is room for difiFerence of opinion. The whole 
first section of the list — "A. — Factors which aflfect the 
attitude of the student toward his work" — may seem to 
imply the notion that college instructors ought to court 
interest and cosset enthusiasm as if undergraduates were all 
spoiled children, incapable of independent endeavor. The 
second section of the list — "B. — Factors which favor 
efiFectiveness of eflfort in the work itself" — may imply the 
notion that the student is to have his work so charted and 
guided for him that it will be all *'plain sailing." Of course 
no such notions are intended, for the first section is meant 
merely to suggest ways in which the student's general will 
to work may be hamessed, directed, or given greater leverage 
or more specific application, and the second to suggest ways 
in which his effort may be made to yield the best results. 
The college student who has no interest in study and would 
rather shirk or himt "snap" courses than apply himself, 
presents a disciplinary problem, not a problem of method. 
Method must be based on consideration of the normal case 
— the college student who has good intentions, who is 
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interested and ready to leam, who does the best he knows 
how. Toward him the college instructor has by no means 
discharged his whole obligation when he lectures as well as 
he can, assigns reading from the best treatises on the sub- 
ject, and provides a list of topics for theses. The methods 
of a primary school are hardly less appropriate in an Ameri- 
can college than the " laissez-f aire " methods of a German 
university. To stimulate purpose and define it, openly and 
without any attempt to interest the student "in spite of 
himself," or to supply conditions and directions for his work 
which shall make it possible for him to get a good return for 
his time and energy, need not mean the sUghtest lowering of 
standards. Indeed such efiForts should make in every way 
for higher standards. 

A suggestion very f requently advanced in the answers to 
the questionnaires, and consequently prominent in the list, 
is that more opportunity be provided for personal contact 
between student and instructor. What students want and 
seem genuinely to need is not contact with assistants or 
younger instructors, but with the men actually in charge 
of courses. The new system of Tutors will supply this need 
in part and for some men, but not as f ully as would increased 
opportunity for conference with professors; and this need 
presents a problem by no means simple. It is easy to agree 
that conferences are profitable; but they are very time- 
consiuning. The problem is at bottom a problem of general 
college economy — the problem of the large course. The 
best solution, without question, is to have the whole work 
of a course done by one man; nothing can compensate to 
the student for the almost inevitable lack of imity between 
the professor and the assistant. It would seem an excellent 
investment of college funds to permit professors in many 
cases to dispense with assistants and reduce the number 
of their courses. Ought not the work of a coUege instructor. 
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as a teacher, to be reckoned in any case by students rather 
than by courses ? And would it be impossible to arrive by 
discussion, without elaborate inquiry, at a reasonable 
measure of the teaching burden one man ought to carry?^ 

There are good reasons, of course, why certain courses 
should be kept too large for a single man to give. In some 
cases it might be f easible to have identical courses given by 
two instructors, but this would introduce certain difficulties 
due to unavoidable differences of abUity and of point of view 
between the two. Where sections offer the best solution, 
as they undoubtedly do, for example, in Economics A, there 
seems to be no way of avoiding their disadvantages except 
by direct eflfort to secure the best possible assistants and 
to unify their work by the most careful management. The 
proposal that assistants receive some training for their work, 
including a practical apprenticeship under supervision, 
deserves careful consideration. The provision of eflfective 
training for prospective college teachers is surely not 
impossible and would be welcomed by many of them with 
genuine interest. 

Outlines and syllabi are mentioned as advantageous in 
several of the comments on the visits, and thus find appro- 
priate piaces in the list. Their advantages are perhaps 
less obvious than their dangers. In some courses, syllabi 
may be undesirable because of the character of the subject. 
It is possible, also, to invite laziness by providing a syllabus 
which has much the character of a set of printed notes, and 
hence tempts students to undesirable "cramming." But 
a well devised syllabus will present topics rather than data 
and conclusions, and will serve rather as a map of the ground 
to be covered than as a means of getting over it without 

1 See Birge, E. A. " How Many Hours a Week Should be Required of Teachers 
in a University?" Transactions and Proceedings of the National Association of 
State Universities, v. 14, 1916. 
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effort. A syllabus may contain statements of the purposes 
of the course and directions for theses, field work, and 
exercises which will prevent misnnderstandings and be of 
much value in guiding the students' eflforts; it should serve 
to unify his impressions from the lectures and the reading; 
and by presenting specific assignments of reading in con- 
nection with each topic it may save time in class and in 
study. Its fundamental advantage is that it makes it 
possible for everyone concemed, but especially for the 
student, to know at every point just where he is in the 
course, where he is going next, and why. 

One object of the questionnaires prominent in the minds 
of the joint committee which framed them was to discover 
to what extent instruction in Economics is missing the needs 
of individual students. What the questionnaires reveal on 
this point is presented in another chapter; but it must be 
plain to anyone who has had experience in college teaching 
that one of our difficulties as instructors — a difficulty not 
so pressing in any lower school — arises from the absence 
of continuous reaction from our students. We do not know 
what they are thinking about, whether or how they have 
grasped our meaning, what objections they might raise, 
what conclusions they are likely to come to. They have few 
opportunities for expression or for interchange bf ideas with 
us or under our guidance. This means educational waste in 
college classrooms; and this is the reason why participation 
in class exercises is so desirable, personal conferences often 
so illuminating, and the purely educational use of tests, 
quizzes, and written papers, with discussion of the results, 
so profitable. We frequently miss the individual simply 
because we do not know, psychologically speaking, where 
he is. When classes reach a certain size it is impossible to 
know individuals intimately at all, and the best we can do 
is to tempt revealing reactions on matters of importaince; 
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I 

but this disadvantage of the large class ought to be empha- 
sized on every possible occasion and we ought to counteract 
it in whatever ways we can. 

Other sections of the Report present records to show 
that students do not give to their several courses anything 
like equal attention or eflfort. In part this is imavoidable 
and even desirable; but in part it is probably due to imeven- 
ness in requirements and to lack of calculation of the time 
reading ought to take, or theses, or practical exerdses. 
College work is necessarily distracting in itself, and the 
student is further distracted by college activities even when 
he gives them only a reasonable amount of time and energy. 
It is surely important that our requirements be justly cal- 
culated, definitely set forth, and accompanied by directions 
so plain and ample that students need not waste time in 
wholly valueless efiForts to find material which ought to be 
readily avaUable. There is in this, of course, no disparage- 
ment of the value of an exercise involving the discovery by 
the student himself of new material or data adapted to his 
individual use but imfamiliar, it may be, even to the in- 
structor. 

In one respect college instruction seems to miss a fairly 
important opportimity to prevent waste of efiFort — it 
seldom diflFerentiates clearly between the types of leaming 
required of students. College instruction easUy becomes 
predominantly verbal — its conditions favor lecturing and 
assigned reading, make difficult the observation of facts 
and constructive reasoning from actual data, and tempt 
instructors to ignore the requirements of the simpler types 
of leaming, such as memorizing from sense impressions. 
Neglect to provide proper conditions for the memorization 
of visual material, or for verbatim leaming of definitions, 
is, however, easy to prevent. Leaming of either of these 
sorts may be conducted so that none but the lazy or def ective 
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can avoid a good result. But it is much harder, as it is 
much more important, to bring students into actual contact 
with the facts and problems of a subject, outside of books. 

In the social sciences college instruction seems peculiariy 
prone to lack of reality. This is in no sense a charge against 
Harvard courses in particular, for there are notable instances 
of provision in Harvard courses for contact with "outside 
activities"; but it is evident that this provision might be 
systematized and extended. Yet it is evident, also, that 
advance in this direction is beset with difficulties. It is 
easy to bring students into contact with sources in literature, 
and not impossible in history; laboratories and specimens 
bring the object of study actually before the student in the 
natural sciences: but it is possible to give a course, for 
example, in Labor problems, without bringing the students 
into any contact whatever with laborers, the labor-market, 
the conditions of specific Industries, or any other facts or 
situations with which the subject deals. It is not only 
possible to do so, but to attempt in such cases to bridge the 
gap between "study" and "life" may seem decidedly 
dangerous. For in Economics, students can sometimes be 
given at best only a glimpse of the facts, and their impres- 
sions may be very misleading and unscientific. A proper 
variety of facts may, furthermore, be quite out of reach. 
There is a strong tendency therefore to avoid disaster by 
sticking to lectures, reading, and the study of documents. 

But if college instruction is reaUy to induce men to think, 
lack of reality is a fatal defect in it. The most educative 
thing a man can do is to observe facts for himself, define 
an issue from them, argue it out with his fellows, and apply 
his conclusions in action or in f urther thinking. The process 
of finding a problem in the facts, and solving it, awakens 
interest and illuminates the subject; to be successful in it 
breeds confidence and suggests new lines of inquiry; the 
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conclusions thus reached become vital and permanent posses- 
sions and aflfect conduct directly and forcefnlly. The most 
pressing need in the method of college teaching in the 
social Sciences is therefore the need of devising "projects," 
"practical" exercises, and means of contact with the facts, 
institutions, conditions, and situations which the various 
courses treat. This need seems already to be recognized as 
imperative, as the appointment of Committees on Practical 
Training by the American Economic Association and the 
American Political Science Association and of a Committee 
on Field Work by the Association of Urban Universities 
would indicate;^ but committee inquiries are less productive 
and more likely to be led astray by visionary leadership 
than is quiet experiment in the courses of a single depart- 
ment. 

Practical training means in the present discussion simply 
a method of teaching, and may be used as such in a course 
which aims at an entirely "cultural" result, as, for example, 
a general understanding of the field of Economics as a whole. 
In a course which aims directly at preparation for vocational 
or other social activity, practical training would natxirally 
be intensified and made continuous. The place and import- 
ance of such courses is discussed above, in the chapter on 
Aims. 

Practical training may of course be overdone, and field- 
work developed as a method without discrimination. De- 
vices and even so-called principles may become for the 
teacher as confining as tradition and a blindly accepted 
procedure. The only end in itself in education, as President 
Lowell has recently emphasized, is the student — but, it 
may be added, the student seen always in relation to the 
society into which his education is to fit him as a member. 

^ See also The Public Servant, a journal published by the Sodety for the 
Promotion of Training for Public Service, Madison, Wis. 
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The only secret in teaching is the secret of keeping clearly 
before one's mind the object to be attained and adapting 
one's procedure to it; but the object is complex and the 
adaptation of necessity varied and often deUcate. The 
Division of Education may well disclaim any ability to 
point out to the Department of Economics a new or better 
road to success than the road it is ahready f oUowing — the 
road of careful analysis of the problems of teaching and of 
continued attention to the details of teaching, as its chief 
duty with undergraduate students. 



CHAPTER VII 

MARKING 

I. A Sttjdy of a Set of Maexs Given in 

ECONOMICS A 

Through the courtesy of Professors Taussig and Day a 
study of marking in Economics A was carried out during 
the spring of 1913. 

Ten mid-year books were selected and marked, after the 
usual careful discussion of standards, by seven instructors 
in the course. In each book there were ten answers, and 
each instructor gave a separate mark for each answer, as 
well as a mark for the book as a whole. The mark for the 
book was of course an aggregate of the ten marks for the 
answers. The resulting series of marks (seven himdred in 
aU) was examined from several points of view, with the 
foUowing results. 

The study considered two main problems, namely, (i) 
what questions of the ten making up the books caused the 
greatest diversity in marking, and why? (2) how greatly 
did the instructors vary in their estimates of the books 
and questions, and incidentaUy, which instructors varied 
most from the central tendency? 

Problem I 

Which of the ten questions caused the greatest diversity of 

judgmentj and why? 

Sheet A (p. 199) contains in detail two samples of the 

data which provided the numerical basis for a solution of 

106 
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this problem. In the case of each question we listed in the 
fijTst colimm (headed Av.) the arithmetical mean of all the 
grades given to that question in each of the ten books. The 
figures given in the columns headed A-G state the devia- 
tion of each marker from the average presented in the first 
colimm. The last coluhm gives the average of these devia- 
tions for the separate books, and the bottom line the average 
deviations for the several markers. By taking the arith- 
metical mean of all the deviations on each question, it is 
evident that we could secure in one figure an index to the 
variation caused by that question. 

Sheet B (p. 200) shows the questions arranged in order of 
this figure. It will be seen that Question 4 caused the least 
diversity and Question 3 caused the greatest diversity. 
In Question 4 the average diversity was less than one grade 
on a scale of ten; on Question 3, nearly a grade and a half. 
On a percentage scale, the diversity on Question 3, Book 
VIII (the book which caused the greatest diversity on that 
particular question) averaged 17 per cent; one marker gave 
the answer zero, another seventy; and only two markers 
gave it the same grade. On Question 4, Book II, all the 
markers agree : this is the only instance of perf eet agreement 
in the one hundred sets of marks. 

The questions were : 

1. Give examples of each of the following: vertical combiiiation; 
intemal economies; localization of industry ; inereasing retums. 

2. In the case of a commodity produced under constant retums, 
does demand determine the price of the commodity or the 
quantity produced? Illustrate by diagram. 

Would your answer be the same if the commodity were pro- 
duced under diminishing retums? 

3. The cost of raising wheat on new land in Canada is said to be 
far below the average cost of raising wheat in the United 
States. Supposing this to be the case, can wheat grown in the 
United States continue to be sold in foreign countries in com- 
petition with Canadian wheat? 
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4. How would a great increase in the world's supply of gold 
affect: (i) The value of the gold dollar. (2) The value of the 
Silver dollar. (3) The price of silver bullion. (4) The price 
of gold bullion. 

5. State briefly what was the course of prices in the United States 
(a) between 1860 and 1870, (b) between 1900 and 19 10. What 
were the causes of the price changes in each period; what evils 
arose; and how could the evils have been avoided? 

6. Arrange the foUowing items of a bank statement in their proper 
order: 

Loans $380,000 

Bonds 50,000 

Notes 50,000 

Capital 100,000 

Other Assets 40,000 

Surplus 30,000 

Undivided Profits 10,000 

Real Estate 22,000 

Deposits 350,000 

Due from banks 10,000 

Notes of other banks 3iOoo 

Cash 35>ooo 

Could this be the statement of a national bank, conducting 
its business in conf ormity to law? 

Suppose the bank to seU bonds which on this statement are 
carried as worth $50,000; selling them at a profit of $1,000, 
and receiving cash for them. Rearrange the statement, and 
consider whether it could then be the statement of a national 
bank conducting its business in conf ormity to law. 

7. How would a great increase in the production of gold in the 
United States affect: 

The imports and exports of the United States; 
The "balance of Tråde" of the United States; 
The price of foreign exchange in New York? 

8. Suppose large remittances to be made by immigrants from the 
United States to their native countries: what consequences 
would you expect on (i) the stock of specie drculating in the 
United States; (2) the relation between merchandise exports 
and imports; (3) the gain which the people of the United States 
secure from foreign tråde? 
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9. Which of the foUowing would you reckon as part of the wealth 
of the country? as part of its capital? 
The Great Lakes, 
The Panama Canal, 
Deposits in banks. 

10. Is the establishment of a manufacturing industry, brought 

into existence by a protective tariflf, advantageous in that it 
creates a home market for agricultural products? 

SHEET A 

Problem I. Also Problem n, Section i 

The relation of the questions to one another in respect to the degree of varia- 
bility which they cause in the marks assigned to them 

QuEsnoN I 

Book Ay. A B CD £ F G Av. D. 

I 8.7 1.3 1.7 1.3 0.7 0.7 0.3 0.3 0.9 

II 8.3 0.3 0.3 0.7 0.7 1.3 0.7 0.3 0.6 

III 8.7 0.3 0.3 1.7 0.3 0.3 1.3 0.7 0.7 

IV 8.1 1. 1 1. 1 0.9 0.9 1. 1 1.9 0.9 1. 1 

V 9.0 1.0 2.0 0.0 i.o 0.0 i.o 2.0 i.o 

VI 7.3 0.3 0.7 0.3 1.3 0.3 1.7 0.3 0.7 

VII 7.7 1.3 0.3 1.7 1.7 0.3 1.3 0.3 1.0 

VIII 6.4 1.6 0.6 2.4 0.4 0.6 0.6 o^ 1.0 

IX 6.7 1.3 0.3 0.7 0.3 0.7 0.3 0.7 0.6 

X 8.4 0.6 0.6 0.6 0.4 1.4 0.6 04 0.7 

Av 7.S 0.9 0.8 1.0 0.8 0.7 1.0 0.6 0.8 

Av. Dev. = .82 

QuEsnoN 4 

Book Av. A B c D E F G Av. D. 

I 9.0 I.o 1.0 I.O 0.0 0.0 2.0 1.0 0.9 

II 7.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 

III 6.9 o.i o.i o.i o.i 0.9 o.i o.i 0.2 

IV 1.6 1.6 0.6 24 0.6 1.6 1.4 0.4 1.2 

V 8.9 1. 1 1.9 O.I 1. 1 0.9 O.I O.I 0.8 

VI 8.1 1.9 1. 1 0.9 1.9 1. 1 1. 1 1. 1 1.3 

VII 6.9 1. 1 0.9 O.I 0.9 O.I O.I O.I 0.5 

VIII 5.1 O.I 1.9 3.1 O.I O.I O.I 1.9 1.0 

IX 7.4 0.6 0.4 0.4 04 04 1.6 04 0.6 

X 9.7 0.3 0.7 0.3 0.3 0.3 0.3 0.7 0.4 

Av 7.0 0.8 0.8 0.8 0.5 0.5 0.7 0.6 0.7 

Av. Dev. — .70 
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SHEET B \ 

Problem I 
Questions in order of the degree of variability which they cauae 

Rank Qaestkm A. D. 

X 4 -yo Least diversity 

2 6 .77 

3 X .82 

4 7 .84 

5 S .86 

6 8 .92 

7 9 95 

8 2 1. 10 

9 10 i.is 

10 3 1.38 Greatest diversity 

Chart I (below) presents the facts under the first problem 
in graphic form. A glance will show that the markers ara 
in f airly close agreement on Question 4, whereas on Question 
3 they spread out horizontally on ahnost every book. 

This Chart suggests also at least one reason for diversity 
in the marking of certain questions. 

It will be noted that the uniformity of marking on Ques- 
tions 4, 6, and i is a xmiformity mainly in the giving of high 
marks. That is, these questions were favorable to agree- 
ment because the students found them relatively easy to 
answer. On the other hånd, the diversity on Questions 
10 and 3 is a diversity caused mainly by disagreement as to 
relatively low marks — an observation which is further 
suggested by the faet that the average mark on each of these 
questions (5.5) is lower than any other. This contrast would 
indicate that "hard" questions caused greater diversity of 
judgment than "easy" ones. 

Other facts bear out this conclusion. Examining the 
chart, we may note, first, that only in one case was there 
marked diversity instead of uniformity of judgment on 
Question 4 — in the case, namely, of Book IV. FoUowing 
the record of Book IV across the Chart, we discover that 
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the student who wrote this Book was generally a poor 
student: his grades fall low on most of the questions. We 
discover also that on almost every question he caused much 
variation in marking. Furthermore, the Chart shows a 
great preponderance, in general, of agreement in the marks 
that fall in the higher half of the scale, as against agreement 
in the marks that fall in the lower half. Four or more 
markers agree forty-five times in giving grades 6-10 inclusive, 
only seven times in giving grades 0-5 inclusive, and three 
of these instances are on grade 5. From tables such as 
those given on Sheet A we may secure a statement of this 
tendency in a single figure — the coefficient of correlation 
between the average grades on all the questions in all the 
books and the corresponding average deviations of the 
markers. This figure is: r = -.401, which shows that as 
the marks descend, disagreement tends to increase. 

To the layman it is easier to see from the form of the 
questions themselves why Questions 4 and 6 should cause 
least diversity than it is to see why Questions 10 and 3 should 
cause greatest diversity; but it is the answers rather than 
the questions which must yield any further explanation of 
variation from question to question, and for such explanation 
as they may yield the whole conduct of the course must be 
taken into account. No doubt the instructors varied from 
one another in dififerent degrees on different questions 
largely because they had different bases in experience for 
estimating what might justly be expected of any student 
on any question. 

Problem II 

Haw do the markers vary f 

I . The tables used in Problem I offered some hdp in the 
solution of this second problem. 

In these tables we had each instructor's deviation from 
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the average mark on each question in each book — loo de- 
viations for each instructor. The avérage of these deviations 
oflFered us an index of each instructor's tendency to vary 
from the central tendency of the group. By this index the 
instructors ranked as f ollows : 

lUnk lostructor A. D. 

I D .83 



2 E 

3 F 

4 G 

4 C 

5 B 

6 A 



89 
91 
93 
93 
99 
14 



On the average, Instructor D varied from the central 
tendency less than one grade on a scale of ten, Instructor A 
varied considerably more than one grade. Instructor D 
agrees with the average seven times, Instructor A, four. 
Instructors E, B, and A each vary once by as much as four 
grades in a scale of ten. 

This index of variability does not show us, however, the 
actual variety of deviation in the case of any instructor — 
it faUs, that is, to show for any instructor how erratic he 
was in his marking or whether he varied from the average 
by marking higher or lower. The extent and frequency 
(but not the direction) of each instructor's deviations could 
be seen, of course, by following his colimm through all the 
tables. 

Some indication of these facts may also be obtained from 
Chart I, but it would be difficult to follow the symbol of 
any given instructor through the several distributions. 

Chart II (below) gives us in a graphic simamary further 
evidence on one of these points, viz., the tendency of any 
instructor to mark consistently "high" or "low," or to 
range his marks in any peculiar fashion along the scale. 
This Chart represents the distribution of all the marks 
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(icx>) given by each instructor, without reference to the 
question or book for which any were given. It shows, 
therefore, only a tendency to give more 4's and 5 's, or more 
9's and lo's than the group as a whole — i. e., variability 
in range of grades but not in the placing of them. Thns 
this Chart shows that Å tended to mark higher than the 
average, since he most often gave the mark 10, but it does 
not show whether his lo's fell with the other lo's or were 
given to quite dififerent questions or to the same question in 
dififerent books. 

2. A graph to show at what points, how far, and in which 
direction each instructor deviated from the central tendency 
in each of his 100 markings would necessitate a very com- 
pUcated figure; hence for graphic representation of variability 
it seemed best to tum to the marks given to each book as 
a whole. These marks, of course, being aggregates, hide 
certain variations: agreement on the book may not 
indicate agreement on a single question; but variation on a 
book is a certain indication of variation on one or more 
questions and might be foUowed back to the fuller data 
given in the tables. 

The character of the variation among the markers is 
shown in several ways. (a) Sheet C shows the variation 
in the ranking of the books on the basis of the marks given 
them by the several instructors. There is full agreement 
as to the worst book — Book IV. There is practical agree- 
ment as to the ninth book, and considerable as to the eighth. 
Thereafter there is little agreement except as to the book 
for first place, Book X, on which six markers agree, the 
remaining marker putting it second. Yet for second place 
six different books are chosen. It is plain that variation 
in judgment is not inconsiderable, in spite of careful effort 
to avoid it. (b) Sheet D shows the extent of variation in 
the actual grades given to the several books. In one case 
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(Book I) this is as much as 28 grades. The least variation 
on any book is 12 grades (Book VI); this would make a 
difference eqnivalent to a f ull grade on the regular Harvard 
letter-schedule of grading. Such a difference might mean 
the difference between passing and f ailure, or between honors 
and a mere pass. Under certain circumstances it might 
determine a man's fate for the A.B., or for the degree with 
distinction. 

This sheet gives ns an opportimity, also, to foUow a 
given instructor's markings through the series of books and 
to discover to what extent any given marker is an extremist, 
or erratic. Thus A is seen at once to be extreme in his 
gradings and a high marker: on five books he gave the 
highest grade, on two books he gave next to the highest, on 
one next to the lowest. B is ahnost as extreme as A, but 
at the other extremity. D is remarkably consistent in his 
close agreement with the median mark on each book. 
(c) Sheet E shows the position of each instructor in relation 
to the median mark on each book. The median is shown by 
the black line; to foUow the deviations of a given instructor 
find his letter imder each book. This Sheet repeats the 
data of Sheet D in another form. (d) Chart III gives the 
graph of the median marks on each of the 10 books, from 
the highest down, and compares this with the graphs of 
the several instructors' marks for all the books in the same 
order. By this Chart an instructor may readily foUow 
his own deviations, (e) Sheet F shows the extent to which 
each marker tends to deviate from the central judgment 
for each book. 
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SHEET E 
Problem n, SEcnoN 2 

Variability of Instructors 

The marks assigned by each instxuctor to each of the ten books, shown in rela- 
tion to the median mark for each book 
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The Interquartile Range is taken as a zone of sound judg- 
ment. The distance (on the scale of grades) by which any 
instructor's mark on any book falls outside this zone can 
be then seen. Thus on Book I, B's mark is 9 points outside 
the Interquartile Range, G's mark 3 points outside. The 
sum of these distances for each instructor, shown on Sheet 
G (p. 210), presents in a single figure his tendency to dififer 
from the group. This figure gives a ranking of the instruc- 
tors as to variability on the whole series of books, which may 
be compared with their ranking as to variability on the 
questions (see above). The following table is a rearrange- 
ment of the results obtained from Sheet G. 

Outside of the Interquartile Range 

Rank Marlier Number of Times Points Above Below 

1 D X X — X 

2 C 3 x8%a 3 S%2 

3 G 6 X 43i loH 

4 F s SH 17H — 

5 E s ^o7H — 2o3i 

6 B 6 27H — 27H 

7 A 8 S'H Spyj X 

Totab X4i%a 7SH 66Ma 

(f) Sheet G and the table just given show roughly the 
relation between variability in grading and the tendency 
to grade higher or lower than the group. The two most 
variable markers are sharply contrasted, A varying 50 points 
above the group to i below it, B varying altogether below. 
There is a similar contrast between F and E. G and C, who 
are not extreme in either direction, tend to vary further 
downward than upward, and if we omit the extreme case 
fumished by A, this is the tendency of the group as a whole. 
This suggests the conclusion that a severe judgment tended 
to lead to greater divergence than a lenient judgment; i. e., 
that the mood of condemnation made for inaccuracy, or 
possibly, that having dedded against an answer the instruc- 



2IO 



THE TEACHING OF ECONOMICS 



tors saw less need for care in rating it. Chart I confirms this 
suggestion. In 38 of the 100 squares on the chart there is 
indicated an agreement of at least three markers and a 
divergence of at least one marker by as much as 3 points, as 
for example, in the square giving the marks on Question 3, 
Book III. Studying these divergences as the extreme cases 

SHEET G 

Problem n, SscnoN 2 

Diveigences outside the Interquartile Range 
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Plus (+) indicates divergence above the Interquartile Range. 
Minus (— ) indicates divergence belaw the Interquartile Range. 

which call for some explanation, we find that 29 of them are 
divergences downward, 17 divergences upward. There are 
six divergences of 4 points downward, three of 4 points 
upward; two of 5 points downward, one of 5 points upward. 
The total variation downward from these selected modes is 
97 points, the total upward 56 points. Divergence down- 
ward evidently tended to be greater than divergence upward. 
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The niimber of books was too few to permit any general 
answer to the question, "Does a poor book cause greater 
variation than a good one?" From what has been shown 
as to poor answers and as to severe judgments, it may be 
inferred that it does. 



II. CONCLUSIONS FROM THE StUDY OF MaRKS GiVEN IN 

ECONOMICS A 

The conclusions of faet from this study may be stated as 
f ollows : 

1. There was much diversity of marking, both on ques- 
tions and on books, in spite of eflfort to avoid it. 

2. Some markers showed a persistent tendency to mark 
eitherhigh or low; others were erratic; some varied very 
little from the central tendency. 

3. The variation on books was snflBicient to be of grave 
consequence to the student. 

4. Poor answers caused greater diversity than good ones. 

5. Severe judgments tended to cause greater divergence 
than lenient ones. 

In so far as these conclusions hold for college marking in 
general, they may fairly be said to make clear two of its 
main requirements : first, that instructors use every means 
to reach clear agreement on standards and to steady their 
judgments in applying them; second, that they grade with 
special care answers which seem to them inadequate. 

In the general discussion which follows, the practical 
problems which these statements suggest are considered at 
some length. It is obvious that no interpretation of the 
conclusions would be safe without a broader basis of faet, 
if this study were unsupported by others of similar character. 
But the problem of marking has been studied extensively 
enough (as the references given below make evident) to 



212 THE TEACHING OF ECONOMICS 

render it unnecessary to gather f urther data in this particular 
instance, although other studies would xmquestionably be 
worth while. It goes without saying that there is no inten- 
tion to imply the slightest lack of eflfort to attain accuracy 
of marking in Economics A or to suggest that the safeguards 
discussed are either unknown to, or neglected by, the 
instructors in that course. This chapter of the Report is 
written in the belief that a general treatment of the problem 
of marking in college courses, based on the data presented 
above, may be of interest, and possibly of profit. 

III. General Discussion 

An economist, Professor F. Y. Edgworth, published in 
the Journal of the Royal Statistical Society, in September, 
1888, one of the first thorough treatments of variation in the 
marking of examinations. There is a certain poetic justice 
in beginning this discussion by a citation from his paper. 
The statement to be cited simis up, in a sense, his "hiraian" 
conclusions, and presents at once the central problem in 
college marking. It is to the eflfect that there are some 
honor men who "like the imsimg brave 'who lived before 
Agamemnon,' . . • are huddled unknown amongst the 
ignominious throng, for want, not of talent, or leaming, or 
industry, or judgment, but of luck.'' 

This is the root of the evil in the marking system — that 
marks are so much a matter of chance. Professor Edgworth 
proves that all marks — even those on large aggregates — 
are as likely as not to be three per cent out of the way. 
Any mark, even imder generally favorable conditions of 
marking, may deviate from the "true" mark by nine per 
cent. That is, there is a probable error of three per cent, a 
possible error of nine, in assigning a mark as representative 
of the student's real proficiency. These errors are reckoned 
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"from the supposed ideal mean which would be presented 
if a large number of competent sets of critics were to examine 
the work.'' The difference between two examiners is likely 
to be much greater ; a given examiner may vary very widely 
from another who might have been in charge. (Many recent 
studies, like the one here reported, confirm this conclusion.^) 
Our students are not wholly unjustified, therefore, in looking 
on the attainment of academic credit as a game, a gamble, 
in which merit counts only roughly, fortime being the real 
arbiter at critical points. 

To the student who has had bad luck, there is small 
comf ort in the advice that next time he make so much greater 
effort as to raise himself beyond the possibility of dis- 
advantage from even a nine per cent error. Perhaps he has 
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already done the best he can. Nor is it much more comf ort- 
ing to assure him that " he is playing a game in which superipr 
skill must make itself felt in the long run." His failure to get 
a "C" or a "B " may put him out of the game; or his sense 
that the game is one of chance may tempt him to try it 
again without much eflfort to improve his skill, in the hope 
that next time his luck wiU run the other way. It is natiural 
to assign to merit whatever one has achieved, to fortime 
whatever one lacks of achieving what he thinks he merited, 
Although the incertitude of marks is not the only cause, 
nor always the chief cause, of that imwholesome attitude 
toward study which is so often noted and deplored, it is 
xmquestionably one of the causes, and one for which the 
student himself cannot be held to blame. 

Not that instructors are to blame, if they make an honest 
eflfort to mark justly. Safeguards against error have yet to 
be more fully developed and tested for general use, before 
anyone can be accused of neglect because his marking is 
somewhat at fault. The error of three per cent calculated 
by Edgworth is an error to which an imcorrected mark is 
inevitably liable, considering the frailty of hiunan nature 
and the imperfection of the data on which marks are given. 
Disagreement among instructors is natiural. Increased 
divergence in the lower part of the scale is also natural, 
since an inadequate answer gives us f ewer data on which to 
base conclusions. But there is no escape from the duty of 
discovering and testing all the available methods of render- 
ing marks more accurate. 

For marking cannot be avoided, nor can the importance 
of accuracy in marking be denied. Every mark we assign is 
important, as an item in an aggregate which, for the student, 
determines success or failure. Even a low mark, on a poor 
answer, ought to be assigned with care. The question is, 
what safeguards against inaccuracy all along the line — 
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from the mark on a single examination answer to the mark in 
a course — are worth trying? 

Eflforts to avoid inaccnracy may be divided into three 
classes, not imrelated nor exhaustive of the possibilities, 
but worth distinguishing : (i) eflforts to simplify the data on 
which judgments are to be passed; (2) eflforts to avoid error 
in the judgments themselves; (3) eflforts to correct error 
in the final retums. The opportimities now apparently 
open under each of these heads wiU be discussed in order. 

I. Efforts to simplify aur data. The prospect of securing 
standard tests in college subjects is very remote. Accom- 
plishment in a college subject is a product so complex that 
no series of simple or uniform reactions can adequately 
represent it. We cannot avoid variation by securing data 
which wiU permit ahnost mechanical grading, as we can in 
the case of elementary arithmetic; nor by using a fixed 
series of questions to which "standard'' answers might be 
given. Our data, consequently, wiU always call for the 
exercise of judgment. 

If it were at all possible, in such a coiurse as Economics A, 
to work out a series of problems caUing for definite and 
easily graded reactions, which might be used as a fair 
measure of accomplishment, it would of course be well 
worth while to make the attempt. If a test could be devised 
such as to give reasonable assurance that 100 per cent in 
passing it meant actual achievement of a high order, that 
50 per cent meant half that achievement, and that error 
in assigning the grade could rarely occur, we should have 
an ideal instrmnent of measure. To fulfill these require- 
ments, the test would have to consist of problems to which 
numerical or very simple and defuiite verbal answers could 
be given ; yet it would have to be comprehensive, and every 
problem would have to be so constructed that mere guess- 
work or the application of simple common sense could not 
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result in a correct solution. Obviously there is not much 
chance of secnring more than a few sets of problems even 
approximating these specifications. If they were used as 
examinations, it wonld take a professional tutor a very short 
time to drill his clients into an easy "mastery" of the course. 
All that it is possible to recommend is that examination 
questions be so constructed as to favor definiteness and 
simplicity in the answers as often as may be; but it may be 
added that a test of the kind described (or anything like it) 
might be very useful and informing as a supplement to 
examinations or as a means of research. 

Examinations do not give us, to be sure, the only data 
on which our marks are based; but our estimates of worth 
in other cases (theses, exercises, laboratory and field work) 
are not less subject to error, but more. There is a fertile 
topic for exact and painstaking investigation in the question, 
How much should examinations coxmt in the final mark, 
and how much any other sort of evidence of accomplish- 
ment? Other things equal, any piece of work which is to 
be marked ought to be presented in a form as favorable as 
possible to accurate estimate of the accomplishment it 
represents. But it is clear that we cannot mechanize the 
work we ask students to do, merely in order .to enable us 
to mark it justly. A piece of work of the greatest value to 
a student may be the hårdest to mark; yet students pay most 
attention to work on which they are to receive grades, and 
the incentives which grading offers cannot be neglected. It 
must be admitted that the effort to simplify data for the 
sake of avoiding error in marking is not so important as the 
effort to secure data which shall signify the full character of 
the accomplishment we wish to rate. 

On this score it would seem worth while to distinguish at 
least four kinds of data: (i) answers to piure "memory 
questions"; (2) the solution of test problems set by the 
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instructor; (3) free expression on topics chosen by the 
instructor or the student; (4) constructive treatment of 
complex practical, scientific, or literary problems. Examina- 
tions give us for the most part data of the first two kinds; 
essays, theses, laboratory exercises, and fieldwork, of the 
last two. In most college courses, we need data of all these 
classes in order to test accomplishment; but power can best 
be evidenced by data of the last three. It would seem 
advisable to devise as many "projects" as we can in con- 
nection with any course (that is, practical exercises involving 
the independent coUection, handling, and interpreting of 
facts in the field the course covers) ; and such work ought to 
be given much weight in the final mark: yet it is not easy 
to grade. As we develop a larger ntunber and variety of 
practical exercises to take the place of a part of the present 
lecture-text-book-test routine, we shall be increasing rather 
than diminishmg the inherent difficulty of acciurate grading. 

2. Efforts to avaid error. There is the greater need, there- 
fore, of effort to steady and correct oiu: judgments. If we 
could look forward to the development in college subjects 
of scales, analytical scorecards, or other objective standards, 
such as are already used to good eflfect in handwriting, spell- 
ing, and certain other subjects of the elementary school, 
we might be content to do as well as we can without other 
aids until that royal road should be opened. But any such 
expectation must be very narrowly limited. The variety 
and complexity of work which is really to exhibit the power 
achieved in most college coiurses puts an objective standard 
of grading out of the question. We must f all back on means 
of rendering subjective standards more reliable. 

To this end nothing can obviate the necessity of care and 
of honesty of purpose, nor diminish the value of experience. 
If a young instructor is working alone, there are not, of 
course, many opportimities for him to improve his judg- 
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ment, except by reflection on his own performance, which 
is always worth while. (For purposes of comparison a col- 
lection of theses, reports, and examination books illustrating 
the various grades would probably be usef ul — an inf ormal 
objective scale, which might profitably be discnssed, in 
certain cases, with the students in the conrse.) In large 
courses, however, where several instructors mark the same 
or similar work, conferences on standards, the multiple 
reading of doubtful books, and the discussion of selected 
books and answers are available as means of acquiring 
steadiness of judgment, although such efforts cannot of 
themselves guarantee agreement. It ought to be possible, 
also, to make the marks on the first tests in the course show 
the tendency of each instructor, so that he may take waming 
and accommodate himself to the majority judgment, as safer 
than his own. (Probably the mode is in many cases the 
safest standard to take for this purpose, since it represents 
an actual agreement. A mode discovered on a second mark- 
ing, after full discussion, could be accepted as almost 
objective in its validity.) College instructors in general 
ought in all probability to spend more time and eflfort in 
the attempt to make their marking acciurate; and several 
"sessions" early in the year, spent on the serious study of 
retums in test cases, might save much time later on — to 
say nothing of the contribution they might make to the 
achievement of the real aim in view. 

In anticipation of difficulties in the marking of examina- 
tions, no single safeguard is more useful than full analysis 
of the desired answers. What each answer is to contain or 
attest ought to be known in advance, and the proposed 
value of the answer in the whole book, and of each element 
in the answer, caref ully considered and discussed, The larger 
the nimiber of elements to be taken into accoimt, the smaller 
will the error of judgment on the aggregate be likdy to be. 
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The advantages of questions as tests of accomplishment 
must be balanced against possible disadvantages due to 
probable difficulty in the marking of the answers. In general, 
it may be said that the making of examinations is quite as 
difficult and important as the marking of them. 

The assignment of values to questions is in itself a special 
problem. Professor Inglis ^ suggests that values ought to be 
equated on the basis of actual performance by the students. 
A question that proves in faet twice as difl&cult as another 
question ought not to have the same weight in the total; 
and on the groimd that we cannot indict a whole class of 
laziness, inattention, or dullness, it would seem that the 
"hard'' questions ought to coimt less than "easy" ones. 
This would mean, of course, a general raising of examination 
grades; but not necessarily the passing of more students 
nor the granting of more honor grades, since these matters 
may be otherwise controUed. 

3. Efforts to correct error. Af ter every practicable effort 
has been made to render judgments accurate, it may still 
be supposed that the final grades are subject to error. There 
remains the possibility of correction according to a theoreti- 
cally determined standard. An ideal grouping may be 
constructed to which the actual grouping shall be made to 
conform, and this procedure can be justified on the groimd 
that it will result in a rating more accurate than that pro- 
vided by any given series of marks. The standard provided 
by the Probability Curve can be accepted only as a starting 
point or remote backgroimd; what is needed is a standard 
derived from a sufficiently large nimiber of marks by a 
sufficiently large number of competent critics, assigned to 
students of the same general type in the given subject. In 
default of such a standard it would seem dangerous to make 

^ Ingus, A. J., "V&rUbility of JudgmenU in Eqiuttlng Values in Gnding/' 
Educational Administralion and Supervision, January, 1916. 
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drastic general use even of a skewed curve determined on 
purely theoretical gronnds. A theoretically determined 
curve may take acconnt of the selective influence of progress 
through school to college and may thus be available for use 
in large general courses, but it cannot be applied to marks 
in a section nor in a small or advanced course. Even a curve 
derived from several general courses does not necessarily 
fit the probable distribution of ability in a group electing 
a particular subject; nor can the accumulation of marks 
over a series of years be subject to criticism if it does not 
conform to such a distribution, imless it can be shown that 
no systematic selective influence has been continuously at 
work on the group in question. A good standard distribution 
for a particular course might be f oimd in the whole series of 
marks in other subjects obtained by men electing that 
course; and such distributions might well be made at 
intervals for all the larger college courses.^ 

If a given course ought by reason of its subject or aim to 
be easier (or harder) than an average college course, some 
adjustment in the standard would have to be made; also, a 
distribution derived from marks in other courses in the same 
field might in some cases seem more useful than one derived 
from courses in other fieids. 

The disadvantage of any such standard is that it ignores, 
or rather directly coimteracts, the effect of good teaching. If 
we aim at a certain minimum accomplishment for every 
member of a course, it is a confession of failure to admit 
that any predetermined percentage of our students cannot 
possibly reach it. Our business is to correct the chance 
distribution of ability among them by laboring mightily with 
those who could not succeed imaided. A student aroused to 
interest by good teaching may justly complain if, after 

^ Edgworth, in the article referred to, p. 624, gives a method for correcting an 
actual series of marks by the use of a standard or ideal distribution. 
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doing his best under sympathetic direction, he is failed on the 
groiind that a certain number of men in the course ought 
theoretically to receive E's. In the last analysis the issue 
is between the instructor's estimate of accomplishment as 
it is evidenced by examinations and other data, and the 
theoretically probable accomplishment of the students he 
deals with. How much shall the deviation of his grouping 
from the normal grouping cause him to distrust his own 
judgment? The distortion of a series of marks honestly and 
carefully given cannot be recommended as a good policy; 
yet continuous divergence from a standard distribution 
properly determined would argue either marvelous and 
improbable efl&ciency in teaching or an imusual and equally 
improbable selection of able students — supposing the diver- 
gence to be upwards on the scale. (A divergence downward 
would be more disturbing to the instructor as to his teaching 
and the ability of the students electing his work, more 
comforting to him as to his standards.) If neither of these 
conditions is likely (as neither usually will be), the only 
conclusion the instructor can come to is that his standard 
of accomplishment is imduly low (or high). He ought 
therefore to reexamine his standard, and make his course 
more (or less) exacting. 

It is fair, then, to say that standard distributions are 
proper instnmients for the use of instructors in the whole- 
some process of critical examination of their own work, and 
that their effect ought to be apparent in the general level- 
ing of requirements in courses; but that they ought not to 
be applied indiscriminately to the correction of every set of 
marks. 

This conclusion stands in direct contrast to the con- 
clusion reached in several recent studies of college marking 
— namely, that students should be rankedy not marked, 
with the corollary that the distribution of ranks should 
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conf orm to the normal distribution. The general procedure 
advocated is that the best performance should be given the 
highest grade and the other performances rated in order 
below it; if the distribution thus produced is not normal, it 
should then be corrected by reference to the standard 
curve. The advantage claimed for this method is that it 
avoids the inaccuracy arising from the attempt to rate a 
student's accomplishment by referring it to a supposed 
objective standard which does not in faet exist. We believe, 
however, that greater injustice and confusion will result 
from this method than from careful effort to estimate each 
individual's accomplishment in terms of a standard made 
as objective as possible (or defined as clearly as possible) 
by discussion, analysis of results, and comparison of grades/ 
To give any student a mark which indicates only that he 
stood last, or twentieth, or first, in a class of one himdred is 
neither just nor informing. The student (and everyone 
else) inevitably takes the mark to indicate achievement in 
the subject. Unless we define how well the himdred did, it 
means nothing to say that A was first or last; and to give 
A the grade which means failure, merely because he was 
last, may work gross injustice. Vague as our standards 
may be, there is more promise of success in the effort to 
define them and apply them with care, than there is in the 
proposal that we ignore them. 

In accepting a rdative standard there is, moreover, a 
subtler danger still. To be assured that an "A" invariably 
means that a student is among the highest two or three 
per cent in his group provides, in one sense, to be sure, an 
exact meaning for the mark — but it teUs us nothing about 
the actual level of achievement in the group as a whole 
and may lead us therefore to accept as a definite estimate of 
proficiency a mark the meaning of which varies in reality 
with every instructor and every class. And when an 
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instructor knows that his marks will be considered "satis- 
factory" if they are distributed in the "normal" propor- 
tions, he may well be tempted to give up aU reference to 
an "abstract" standard of achievement and hence to be 
content with whatever proficiency his instruction produces. 
Reference to an "objective" standard is salutary to student 
and instructor alike. There is no safety in marking except 
through the effort to define a standard and to mark as 
justly as may be in terms of it. The "normal distribution" 
serves best as a basis of criticism for the standard an in- 
structor has actually in mind. 

There is one possible precaution against error which our 
Harvard marking system does not favor — namely, the 
building up of the final grade from a large nimiber of items. 
An aggregate is much less liable to error than a single 
item : hence a final grade reckoned from a niunber of grades 
for single points (papers, exercises, examination questions) 
is more likely to be just than a grade assigned at a broad 
guess. But computation of grades means the use of nimieri- 
cal values, and we use an official scale of letters not defined 
in numerical terms. This raises the general question of the 
most advantageous number of gradations in the marking 
scale. There can be no doubt that the percentage scale 
contains too many gradations for effective use: indeed, 
teachers fail to use more than the main points on the scale, 
as the clustering of their marks aroimd the natural modes 
(the fives and tens) bears witness. But a scale with ten 
gradations is apparently quite usable; and such a scale may 
be expressed in nimibers. Using a scale of ten we may 
construct a final mark which represents an aggregate of 
single impressions rather than a single (and very general) 
impression; and when this aggregate covers a considerable 
number of items the chances of error are much reduced. 

Against this procedure it may be urged that the grouping 
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of students into five main dasses (A's, B's, etc), with due 
regard to the conf ormity of our grouping to the ideal group- 
ing, is more likely to avoid error than is any other method. 
It is true that broad distinctions are easier to make; and final 
rating in terms of such distinctions is therefore desirable. 
But in the doubtful and border-line cases ("high C" men, 
"low C" men, et al.) we are thrown back on some method 
of checking up our estimates. Our distribution may con- 
form in general to the ideal grouping, but who shall tell 
whether we have dealt justly with the individuals thus 
grouped? 

Accuracy in marking of ten demands the combination of 
separate items, the computation of an aggregate from 
weighted parts, and other calculations; and this demand 
cannot be fulfilled if we use only relative ranks expressed 
by letters. 

In the end it must be recognized that there is no short 
cut to justice in marking. Care and effort are essential 
everywhere. Fimdamental in the whole business is the 
necessity of organization in the work of the course itself : 
the fitting of requirements to the limitations of the student's 
time and to his stage of advancement; the most advantageous 
balance in the assignment of reading, conferences, papirs, 
practical exercises, and other work; the best arrangements 
for guidance and the greatest explicitness of instructions 
without loss of initiative to the student. Our courses need 
a measure of administrative standardization, which need 
not mean in any sense mechanization. Definiteness as to 
the demands which a college course may reasonably make 
on a student's time and effort is the best basis for every 
attempt toward accuracy in the grading of his work. 



CHAPTER VIII 
Summary or Conclusions and Recommendations 

Tms chapter brings together in a series of brief statements 
the more important conclusions and recommendations of the 
Report. These have been arranged by groups in the order 
of their general importance; that is, the conclusions and 
recommendations we consider fimdamental have been pre- 
sented first and in a separate group, other tindings and sug- 
gestions, even though they may be of more immediate prac- 
tical interest, being grouped thereaf ter imder special heads. 
These statements are all subject to the qualification men- 
tioned on page 6 ; and we simmiarize them here not in order 
to insist on each in tum, but in order to bring them into rela- 
tion to each other and to promote convenience of reference. 
It seemed desirable thus to present the major results of the 
Inspection in a grouping indicative of our own interpretation 
of their relative significance. The numbers in parenthesis 
ref er to pages on which the various conclusions and recom- 
mendations are stated or discussed, or on which facts in 
support of them are given. Evidence and argument from 
scattered portions of the Report are thus combined to show 
what seems to us their logicai bearing. 

I. Conclusions and Recommendations of General 

Importance 

A . Concerning the Study and Regulation of Instruction 

Undergraduate teaching should be subject to fuller de- 

partmental discussion and supervision (lo, 13, 17, 18, 174, 

»»s 
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178, 190). The problems of teaching should be given more 
direct and objective study (4, 9, 10, 15, 88, 95, 96, loi, 178, 
190). The normal amoimt of teaching should be reckoned 
more exactly and the importance of teaching be given fuller 
recognition (10, 14, 15, 88, 190). 

B. Concerning the Aims and Organizalian of Courses 

The aims of courses should be more clearly defined (17, 25, 
171, 173, 174) and students made more fully aware of them 
( 1 50, 1 70) . The predominantly practical purposes of a large 
majority of the students (28, 113, 115, 147, 148, 149) should 
be recognized in the organization of curricula (10, 13, 21, 22, 
26, 31, 32, 33i 34, 13S1 iS9i 160, 174). 

C. Concerning the Effectiveness of Instruction 

Instruction should be more closely adapted to the purposes 
and needs of thestudents (10, 12, 13, 87, 151, 152, 161, 162, 
166, 176, 177, 189, 192, 197, 211, 224). Personal contact 
between professors and students should be more frequent 
(14, 114, 116, 136, 152, 162, 164, 180, 189, 190). Fuller 
guidance in the choice of courses (116, 150, 174) and in meth- 
ods of study (13, 14, 87, 165, 192) is desirable. Occasions for 
participation in class and for reaction on lectures and reading 
should be more frequent (114, 162, 180, 191). Teaching 
should have fuller reference to contemporary aflFairs and the 
work of students should provide more frequent occasion for 
direct and personal contact with them (10, 26, 83, 115, 116, 
139, 140, 151, 161, 162, 166, 173, 180, 194). 

II. CONCLUSIONS AND ReCOMMENDATIONS ON SpECIAL 

Topics 

A. Concerning the Relation of Economics to Other Subjects 

The relations between ranking in Economics courses and 
ranking in courses in any other subject do not justify 
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special recommendations (35, 39, 56). As compared with 
the "typical" Harvard correlation coefficient of 50 per cent, 
the correlations of Economics A with Mathematics C and 
with Government i are fairly high; other correlations of 
Economics A are low (52, 57, 58, 59). Government i seems 
to have the closest relation to Economics A and Government 
in general to Economics (35, 37, 58, 150). Interpretations 
of correlation coefl&cients should be made with caution (55, 
56, 64, 65, 66) ; but correlations between Economics marks 
and admission marks support the belief that admission ex- 
aminations are poor tests of ability (60, 67, 70). 

B. Concerning the Relations of Economics Courses to Each 

Other 

Standing in Economics A does not materially aflfect the 
election of advanced instruction in Economics (44, 45); 
and although men of high rank in Economics A are much 
more likely to go on to strictly graduate work (44, 46, 50), 
men of low rank may do well in middle-group courses 
(50). There are marked diflFerences in the abilities of the 
groups electing the several advanced courses (50, 51, 57); 
and in the grading of advanced students there is some arbi- 
trary and avoidable shifting of marks (49, 50, 63). 

C. Concerning Marking 

Neither the standard distribution of marks for the De- 
partment (40) nor the "Probability Ciurve" (42, 219 ff.) 
can be taken as a final basis of critidsm for course distri- 
butions (40, 42, 57). An agreement (mode) is a better basis 
than an average or median (40, 2 1 8) . Standards at mid-years 
and at finals should be the same (41). College marking is at 
best far too much a matter of chance (197, 202, 203, 206, 
213) and every care is needed to make it acciu^te. (215 AF.) 
Poor answers in examination books are hårdest to grade, and 
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severe judgments most likely to be erratic (200, 201 , 209, 
210). The ranking of students and the assignment of grades 
in fixed proportions according to a standard distribution is 
to be condemned. (219 S.) 

D. Concerning Details of Instruction 

There is great dissatisfaction with assistants and with 
sections; sections should be given up wherever possible 
(115, 136, 161, 162, 164, 179, 190). Class discussion as a 
method is favored by a niunber of graduates (114), and 
greater care in the assignment, coordination, and facil- 
itation of reading is desired (151, 152, 161, 162, 166). 
Memory work is not imduly stressed (106), but devices 
for sharpening interest could well be multiplied (92, 93, 94, 
106). Graduates, advanced students, and students of high 
standing profit most from lectures; other students get more 
from other phases of their work (114, 154, 157). 

E. Concerning the Students 

The purposes of the students are primarily practical, 
either vocational or social (149, 159, 160), and curricula 
should be framed to meet their need of practical training 
(31-34). They choose courses largely on their reputation 
(150, 174) and are but little able to distinguish the specific 
values of the instruction they receive (150, 159, 170). In 
their study they have in mind primarily the requirements 
of courses (87) ; and they need guidance in methods of work 
(87, 88); but they are interested in many contemporary 
problems (160). Yoimg students are at no disadvantage in 
Economics courses (71). 



SUPPLEMENTS 
I. A List or Problems for Investigation 

I. The student body. 
I. Preparation. 

(a) Are students admitted to any course too young to 
profit by the work? 

Study age and rank correlations in Economics i 
and perhaps other courses. 

Ought the department to restrict admission to 

its courses by age or dass? 

(b) Are students who have taken History or Civics in 
high school or History or Government in college 
at any advantage over other students in Eco- 
nomics A? 

Study rank in Economics A of students who 
have passed in advanced admission History, 
Economics, or Government; also rank of those 
who have had History I, Government I, or both 
in college. Use test questions in Economics A. 
Ought the Department to require any prep- 
aration courses for Economics A? 

(c) What requirement of coiurses in Economics, His- 
tory, or Government, or other subjects should be 
made of students admitted to advanced Eco- 
nomic courses? 

Study ranks, give tests in class, inspect students' 

lecture notes, teachers' syllabi. 
What sequences of coiurses ought the Depart- 
ment to insist on? 

(d) What is the initial equipment of students in the 
Department? in knowledge of economic data 
and problems? in power to deal with economic 
questions? 

Test questions in Economics A. 
Ought the Department to have a standard 
test of this sort? What suggestions for the 
elementary course does it yield? 

»»g 
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2. Conditions of study. 

(a) Are thesis work, reading, and fieldwork economi- 
cally distributed? 
Study inddence of assigmnents — amounts of 
reading to be done, theses, etc. in individual 
cases. 
Ought the Department to make more careful 
rules as to assigmnents? What is the normal 
amomit of reading and thesis work for an 
midergraduate course? 

3. Personal aims. 

(a) Are students selecting Economics courses inteUi- 
gently and purposefully? 

Questionnaire as to personal aims, and the value 
of instruction in subserving them. 
What data as to personal aims ought in- 
structors to have and what account ought 
they to take of such data? What advice as 
to selection of courses is needed? How should 
courses be advertised? 

(b) Are students attempting to secure the degree with 
distinction with full understanding of its value? 

Questionnaire — statistics as to numbers tak- 

ing degree, failures, etc. 
Should any changes in the conditions, an- 
nouncementSy or management of the degree 
be made? 

(c) Is concentration in the Department intelligent 
and purposeful? 

Questionnaire — statistics — facts conceming 
advice given, conferences with instructors, etc. 
Ought the Department to guide more care- 
fully students who concentrate? 

(d) Is candidacy for the Ph.D undertaken with ade- 
quate information conceming the values of the 
degree and of the work for it, and with dear aims? 

Study of careers of former candidates — ques- 
tionnaire — study of thesis subjects — statistics. 
Ought the Department to differentiate its 
work for the Doctorate or dissuade any from 
attempting it? 
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4. Social demands. 

(a) Does the instruction in the Department meet the 
needs of graduates for economic information and 
insight? 
Questionnaire to graduates and business men 
in general, economists, and officials. Test ques- 
tions to students, espedally to students who 
have taken only Economics A and are now in 
Senior Year or in a Graduate School. 
What practical needs ought instruction, es- 
pecially in Economics A, to meet? 

5. Capacity and achievement. 

(a) What are the factors in the problem presented by 
the D and E men? 
Study individual cases to determine causes of 
failure and poor work. 
Ought the Department to keep more careful 
and more readily available records of stu- 
dents' work and regulate admission to courses 
in the light of such records? 

(ft) What can be done to make more eflFective the work 
of high-grade men? 
Questionnaire as to aims of A and B men and 
the relations of their work in Economics and in 
other Departments. 
Ought the Department to undertake more 
careful guidance of the work done by high- 
grade men? 

II. The instruction. 

1. Aims. 

(a) Are the aims of the courses and groups of courses 
adequately defined? 
Study pamphlet, talk with instructors and stu- 
dents, consult economists. 
Ought the Department to define the aims of 
its work more dearly or on a new basis? 
How should it advertise the work? 

2. Scope. 

(a) What portions of the economic field are not cov- 
ered by the instruction, if any? 
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Co5peration of economists. Study of instruc- 
tion offered in other imiversities. 
Ought the Department to expand its work? 

(b) Does the instruction provide adequate training in 
the more important methods of economic investi- 
gation and economic thought? 

Co5peration of economists. Study of other 
universities. Inquiry of instructors. 
Ought the Department to cover Economic 
Methods in a separate course, or otherwise? 

3. Organization. 

(a) Is the work so distributed that it meets best the 
needs of the students? 
Study enrolhnent in coiurses. Question stu- 
dents and instructors. Cooperation of eco- 
nomists, business men, govemment officials. 
Ought the Department to strengthen certain 
fieids? 

{b) Is the work so organized that there is a mininiiiTn 
of duplication of eflfort? 

Study students' and instructors' lecture notes 
— terminology — topics. 

Ought the Department to agree upon terms 
and the treatment of topics? 

(c) Is the work organized so as to bring the students 
and instructors into touch with the economic 
forces and agencies in the outside world? 

Study plans of work in courses, conferences, 
etc, and non-instructional activities of the De- 
partment. Cooperation with economists. Other 
universities. 
Ought the Department to plan for more defi- 
nite contact with the economic world? 

(d) Is the work so organized as to enable students to 
acquire insight in the field as a whole and power 
in special fieids? 

Study correlation of courses, actual curricula, 

fieids of theses for degrees with distinction, Ph.D. 

candidates, etc. 

Ought tiie Department to open new possi- 

biUties of spedalization, and new opportimity 

for coordination of courses in groups? 
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(e) Is the work so organized as to make full iise of the 
students' related work? 

Study corrdation of courses in History, Gov- 
ernment, Social Ethics, Education, Anthropol- 
ogy, as to hours, periods of history, etc. 
Ought the Department to plan more directly 
for correlation? 

(/) Is the work so organized as to minimize the dis- 

advantages of large courses? 

Study the work of conference and section as- 

sistants. What are the variations of method, 

marking, hours, and results among sections? 

Question students and instructors. Apply tests. 

Ought the Department to divide large courses 

into smaller courses or use administration 

measures for further control and improve- 

ment of the work done in large coiurses? 

4. Administration. 

(a) Is there an adequate system of administrative 
control of instruction? 
Study the provisions for administrative con- 
trol by consultation with members of the De- 
partment. Study the plan of administration in 
other imiversities. 
Ought the Department to devise a more com- 
plete system of administrative control and 
assign the work to members relieved from 
instruction for that piupose? 

{b) Is the marking system effectively used? 

Tests to determine subjective variations of 
standard. Curves of marks in coiurses to deter- 
mine range of marking. Questionnaire as to 
aims in the use of marks. 
Ought the members of the Department to 
agree more definitely as to bases for marking 
and the use of marks? 

{c) Are examinations in the several courses effec- 
tively used? 
Study the examination questions: Do they test 
the student's knowledge? Do they permit in- 
structors to grade students on examinations 
justly? 
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Ought the Department to agree upon methods 
of examination and the use of examinations 
as tests and as educative exercises? Is there 
a possibility of agreeing upon the weight ex- 
aminations ought to have in the make-up of 
the final mark for a course? 

(d) Is it possible to devise and apply a standard 
measure of progress in capacity to handle eco- 
nomic data and solve economic problems? 
(iet the cooperation of the instructors of the 
Department and of economists outside the 
university in devising a series of test questions 
which can be applied from year to year to show 
progress in general grasp of economics. 
Ought the Department to test students who 
concentrate in economics and determine in a 
general way the progress they are making 
from year to year? 
5. Method. 

(a) Is inductive presentation possible and fruitful in 
particular courses? 
Experiment with inductive and deductive pres- 
entation. 
Ought instructors to resort as often as possi- 
ble to inductive procedure? 

(6) Is it possible to teach economics through the ac- 
tivity of the students themselves in gathering eco- 
nomic data, attempting economic generalizations, 
and facing economic problems? To what extent 
can actual economic investigation be used as a 
means of instruction, in the place of reading and 
abstract discussion? 
Experiment with student activity as a means of 
mstruction. 
Ought the Department to organize more op- 
portunities for laboratory and field work? 

(c) Is the leaming of economic facts and prindples 
properly conducted and adequatdy tested by 
instructors? 
What are the kinds of data instructors think 
necessary to be leamed? Is there any attempt 
to guide the students in the memorizing of this 
material? Åre tests and discussions suffidently 
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frequent to give ample opportunity for recall 
and application of the material? 
Ought the instructors to make a doser study 
of the presentation of those parts of their 
material which they expect students to retain 
exactly in mind? 
III. Thestaff. 

1. Size. 

(a) Is the staflf adequate for the work to be done? Is 
the work properly distributed? 
Personal data from instructors. Inquiries among 
students conceming value of conferences with 
assistants. 
Ought the Department to try to secure more 
men, or more men of a given rank? 

2. Selection. 

(a) What is the method of nomination of new mem- 
bers of the staiff and what are the recognized re- 
quirements for appointment? Is there any diflFer- 
entiation of requirements for diflFerent kinds of 
work) such as emphasis on teaching power for 
work in Economics A? 
Inquiry and general discussion. 
Ought the Department to adopt a more 
dearly defined policy in the selection of 
teachers? 

3. Organization. 

(a) Is the organization of the staff suffidently defi- 
nite, so that responsibility for the achievement of 
specific aims rests dearly on individuals? 
Inquiry among members of the staff and general 
discussion. 
Ought the Department to group courses for 
more definitdy educational purposes, and 
divide responsibility for the accomplishment 
of them? 

4. Diverting interests. 

(a) What outside work do members of the staff un- 
dertake and what relations do such tasks bear to 
the work of instruction? 
Personal inquiry among members of the staff. 
Ought the Department to define more dearly 
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the duties which may properly be under- 
taken as professional activity by members of 
the staff and arrange instruction accordingly? 

IV. Equipment and resources. 

(a) What does instruction in Economics cost, as a 
whole, and by courses, both absolutely and in 
comparison with other subjects? Is the cost 
reasonable, considering the results? 

II. Theses in College Courses 

The writing of theses in college courses — how many 
are required, of what length, at what times, of what value 
to the student, xinder what standards of content and of 
form — may be pictured in some detail from the replies to a 
questionnaire sent to Seniors in Jxme, 19 14, by the Conmiit- 
tee on the improvement of students' English. This study was 
made by a member of the Division of Education serving on 
the Committee and is here for the first time reported in full. 

The questionnaire read as f oUows : 

In accordance with the request of the Board of Overseers, a Com- 
mittee has been appointed to suggest methods of improving the qual- 
ity of English written by students in college. The Committee will 
be greatly obliged to you if you will fill out this blank and mail it at 
once in enclosed envelope. Please do this with as much accuracy as 
possible, and without delay. 

CHARLES H. GRANDGENT, CAflfrma«. 

Date when 

student was in- 

tonatd ci thesis 

Length requiiement Date when 

Subject of (in words and thesis was 

Coune Thesis approzimately) subject handed in 

1. Name of student: 

2. Theses written in 
1913-14. 

3. Other larger pieces 
of written work 
(not including 
those in courses 
in English Com- 
position) 
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4. How far were your theses (and other like tasks) marshalled con- 
veniently, how far did they come due at dates inconveniently near 
each other? 

5. Were you notified that the English used, the style and arrangement, 
were of importance? 

6. How much attention did you actually pay to these matters? 

7. Remarks and suggestions: 

Four hxindred and twenty-two blanks were sent out and 
ninety-four repUes received. The foUowing table shows 
the number of theses and "other larger pieces" written 
during 1913-14 by the ninety-fonr students who replied. 
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Some students evidently suffer from a "congestion" of 
thesis requirements — not so many as to make this dis- 
advantage an excuse for general laxity in students' English, 
but enough to make it apparent that instructors should use 
care in assignments. 

The foUowing table shows the " thesis-economy " of these 
students from another angle. It presents what may be 
called the " total-word-burden " of thesis writers during an 
academic year. 
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Students wiiting in all between 30,000 and 25,000 words — 
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A f ew students evidently have to write far too much in the 
coiurse of a college year — not so many, again, as to 
account for generally poor English in the College, but 
enough to make clear the need of care in managing 
assignments. 

The average length of theses, in words, is 8079; of "other 
large pieces," 3626. 

The f oUowing table shows how the theses were marshalled 
throughout the year — that is, it shows how many students 
were writing at a certain rate in any given month: e. g., in 
March, five students were writing at the rate of 20,000 to 
40,000 words. 

Number of students writing at various rates (in hundreds of words) in the 

several months of the Academic Year 
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Some students are plainly "rushed" in their thesis work. 
The testimony of the replies shows that 54 men foxmd their 
theses conveniently marshalled and 17 found them incon- 



SUPPLEMENTS 239 

veniently marshalled. Twenty-three gave no testimony on 
this point. 

The average length of time for the preparation of a thesis 
was two and three-fif ths months — a fair period for a thesis 
of reasonable length, if the materials are available without 
prolonged search and if they are not xmduly difficult to 
assemble and present. 

Thirty-four men were notified that " the English nsed, the 
style and arrangement, were of importance"; forty-nine were 
not so notified; eleven made no answer on this point. 
Twenty-eight paid considerable attention to English; forty- 
six paid little attention to it; six none. Twelve made no 
statement conceming their effort to write well and two 
answers were doubtful. Neither instructors nor students 
pay enough attention to the English used in theses. 

Special mention of theses in Economics courses occurs 
in some replies and is implied in others. The trend of this 
testimony may best be seen from the f oUowing quotations : 

Paper No. i. Economics courses in which theses were 
written: 4a, 6a, 2b, 4b. 

'' In the Economic courses I paid very little attention to English, 
mostly because I did not have time and it was not required, and 
secondly, because I felt that my instructor did not know much 
more English than I did. This is not in praise of myself , but more 
a criticism of the instructor. If there had been more room on the 
paper I could have told you more. I feel very strongly against the 
present young instructor at Harvard. Of course they get the best 
for the money that is given for that purpose, but I have seen too 
many that do not imderstand yoimg men and are very hard to 
approach." 

Paper No. 5. Economics courses, etc.: 4a, b4. 

''The whole system of assigning work seems rather slipshod. 
When work is arranged conveniently it is rather by chance than by 
any systematic plan." 
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Paper No. 6. Economics courses: 4a. 

''My only suggestion would be to announce the subject of the 
thesis at the beginning of the year and let the student who has 
more than one choose his ovm time for doing it before mid-year; 
also put a slight requirement on good English." 

Paper No. 15. Economics courses: 43Ly 9, 33. 

''No particular emphasis was placed on these qualities, although 
all insisted upon bibliographies, and in some cases, critical biblipg- 
raphies." 

"Although theses are very valuable in most courses, I think 
there can be too much of a good thing. Life for me this year has 
been one thesis af ter another — ' with a little profanity throinm in.* " 

Paper No. 23. Economics courses: 4a. 

''If advice in conferences on theses was not limited to scope 
and sources but included also a detailed consideration of arrange- 
ment of material, a gain in cleamess, if nothing else, would result.'* 

Paper No. 25. Economics courses: 4a, 4b. 

''Reports such as those in Economics 4a and 4b have to contain 
many statistics and are not well adapted to literary style.'* 

Paper No. 27. Economics courses: 33. 

"Only in the Economics 33, for distinction, was much atten- 
tion to such given." 

"Conceming pure research, in many courses, too much em- 
phasis should not be placed on the English and style, for the stu- 
dent may have but a poor store at his command, and yet prepare 
a valuable work." 



III. Age and Scholarship 

The general relation between age, scholarship, and 
academic discipline is shown by the f oUowing quotations 
and charts from an article in the Harvard Graduates' 
Magazine for June, 1913. 

The facts which are used in this study were gathered from the 
college records of 5769 students — all the "regular" Freshmen en- 
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tering in the classes from 1902 to 191 2 inclusive — that is, all the 
students in these classes except those who entered as "special" stu- 
dents, or as ''unclassified" students, or as students admitted from 
other colleges. Each record was classified, according to the student's 
age at entrance, to show whether he had been (i) admonished, (2) on 
probation once, (3) on probation more than once, (4) visited with 
severer discipline (such as suspension), or (5) expelled permanently. 
The cases of students who left "for other than disciplinary reasons" 
were separately recorded. Also, the cases of students who achieved 
the degree cum laude or better, were separately recorded. The rest 
were classified (with no disparagement to their claims for distinction 
on other grounds) as students "of no record." The classification was 
in faet much more complicated than this, distinguishing discipline 
"for low rank" and "for conduct" and dividing the records in other 
ways; but for present purposes the groupings just named are most 
significant. 

The sunmiarized results of this labor are simple and striking. Of 
the total number of students entering at each age from 15 to 22, they 
show what proportion got into "trouble" of any sort with the Col- 
lege Office, what proportion achieved at least the lowest form of 
regular academic commendation at Commencement, and what pro- 
portion escaped both discipline and distinction. The three curves 
plotted on the following chart present these facts in graphic form. 

The points in these curves indicate, of course, percentages. Thus, 
of the total number who entered at 18, 39.40 per cent were at least 
admonished by the College Office, which is shown by a point on the 
black cursre of "wickedness"; 40.69 per cent were "of no record," 
which is shown by a point on the dotted curve of "inofiFensiveness"; 
and 19.80 per cent graduated cum laude or better, which is shown by 
a point on the broken curve of scholarship. 

Af ter accuracy in compilation, the importance of statistics depends 
on the number of cases recorded. Because the group that entered 
at 15 shows the highest percentage of scholarship and the lowest per- 
centage of "wickedness" we can by no means safely conclude that 
fif teen-year-old boys would be the best population we could get for a 
Freshman dormitory. There are only 19 cases in the whole group. 
The sixteen-year-old boy group is larger, but still too small for safe 
conclusions — 218 cases. The groups entering at 20 and over are 
also small. But the groups recorded between the two heavy vertical 
lines — the seventeen, eighteen, and nineteen-year-old groups — are 
all large and not too widely disproportionate: 1102 cases at 17, 1981 
cases at 18, 1394 cases at 19. These numbers are great enough to 
give us a fair basis for argument. The continuous rise in the "wick- 
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edness" curve, and the continuous drop in the sdiolaish^i ciuve, 
canying across the lines for these three big groups, show a leal teo- 
doicy, on which we may rely. 

This tendency is clearly in favor of youth. Tke coUege geb betUr 
average results, wUh las fricHon, from younger men than from oider 
men. Possibly this faet may be shows more dearly by a diart (rf 
colmmis representing actual numbers than by a diart of curves rep- 
See Chart H. 
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H«rc the three groups of columns represent together all the stu- 
dents admitted at the ages really in question — 17, iS, and 19. The 
numbers for these ages do not vary so markedly as to Mde the true 
proportions of the columns in each group — the black column for 
college "sinners," the white column for college "common folks," the 
shaded column for college "saints." If Dean Hurlbut and Mr. Cram 
could meet (say in the Yard at the opening of the year) three groups 
of entering students prophetically divided as these columns indicate, 
there would be small doubt as to wfaich group they would welomie 
most heartily to Harvard Collie. 
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Now it may seem that in all this there is too much "lumping" of 
results. "Trouble" means anything, from admonition — a simple 
waming from the guardian of college morals — to complete dis- 
inheritance by a mortally offended Alma Mater. This might obscure 
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sudl difFerences in the tendeodes of "youth" and "age" to give con- 
cem to the Administrative Board as would really vitiate conclusions 
about the relative burden of transgression among young men and old. 
Perbaps among older students "a word to the wise is auffident," 
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whereas among younger ones hot heads cannot be restrained with 
wamings. As a faet, the exact opposite is the case. Chart III shows 
"wickedness" analyzed into its several categories. The proportion 
of students of a given entrance-age who finally reach any circle of this 
Inferno can be f ound by noting the point where each curve crosses the 
line for that age. 

The significant thing about this chart is the point, marked by an 
appropriate star, at which f alls the largest percentage of students re- 
ceiving each particular kind of college censure. Among the younger 
students the proportion content with the milder college punishments 
is large; as we go up the ages the severer penalties claim a greater share. 
Quite a different result would not have been surprising. 

Scholarship, analyzed, shows an analogous result. The younger 
men have an advantage over the older, except that the oldest — those 
who entered at 22 and over — show some superiority when compared 
with those who entered a year or two earlier. The curve for the magna 
cutn laude men is slightly irregular; but the chart as a whole shows the 
same relation of age to the several grades of scholarships as is indicated 
by the curve for the "Ivunped" result, in Chart I. It is not especially 
surprising, of course, that the yoimger men, up to a certain age, are 
better students, on the average, than their older dassmates. But it is 
worth noting that the superiority of the yoimger men persists, through 
the three important ages, for every grade of scholarship. See Chart IV. 
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V. A List of Documents and Materials Used in 

COURSE OF THE InSPECTION 

1. Pamphlets of the Division of History, Government, and Eco- 
nomics, 1912-13, 1913-14, 1914-15, 1915-16. 

2. Report of the Committee appointed by the Department of 
Economics to consider Courses of Instruction. 

3. Votes passed by the Department of Economics conceming 
courses. 

4. Outline of a Plan for a General Final Examination in the 
Division of History, Government, and Economics. 

5. Division Examinations for the Degree of A.B., 1915-16. 

6. Schedule of courses in approved specific fieids of concentra- 
tion within the Department of Economics. 

7. Letter from Professor Bullock, March 7, 1913, conceming 
guidance given to students by members of the Department. 

8. Letter from Professor Bullock, November 10, 19 14, concem- 
ing coordination of courses in the Department. 

9. Report of Mr. John Wells Morss of the Visiting Committee 
for the Department conceming section meetings in Economics A. 

10. Statement by the Committees on Practical Training appointed 
by the American Political Science Association and The American 
Economic Association. 

11. Preliminary Report of the Committee on Practical Training, 
American Political Science Association, Proceedings 1913-14. 

12. Questionnaire on Field Work issued by the American Associa- 
tion of Urban Universities. 

13. Article on Sequence of Courses in Economics at the University 
of Chicago, Journal of Political Economyy Vol. XXI, No. i, Leon C. 
Marshall. 

14. Article on the College of Commerce and Administration of the 
University of Chicago, Journal of Political Economyy Vol. XXI, No. 2, 
Leon C. Marshall. 

15. Survey Summary, University of Wisconsin Survey. 

16. Comment of the University Committee on the Survey Sum- 
mary. 

17. Miami University Bulletin, Series XI, No. 10. 

18. Bulletin of the Massachusetts Institute of Technology, Vol. 
46, No. 2. 

19. Efficiency Measurement in College, Harvard Alumni Bulletin^ 
Vol. XVI, No. 8, President Lowell. 
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20. College Studies and Professional Training, EducaHandl Remew^ 
Vol. 42, No. 3, President Lowell. 

21. Tests of College Efficiency, Report of a Spedal Committee of 
the Oberlin College Faculty, igoS-g. 

22. Academic and Industrial Effidency, Bulletin No. 5, The Car- 
negie Foundation for the Advancement of Teaching, 1910. 

23. School and University Grades, Bulletin of the University o£ 
Wisconsin, No. 368, Walter F. Dearbom. 

24. The Relative Standing of Pupils in the High Schools and in 
the University, Bulletin of the University of Wisconsin, No. 312, 
Walter F. Dearbom. 

25. Sdentific Grading of College Students, University of Pitts- 
burgh Bulletin, Vol. 8, No. 21, Raymond W. Sies. 

26. Sdentific vs. Personal Distribution of College Credits, Popuhr 
Science MotUhly^ April, 191 1, President William T. Foster. 
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